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Underwater Surveillance Walking Robot Developed 


43064062 Tokyo 4TH INTELLIGENT ROBOTS SYMPOSIUM PAPERS in Japanese 
13/14 Jun 88 No 103 pp 21-26 


[Article by Mineo Iwasaki, Junichi Akizono, Masashi Nemoto, and Osamu 
Asakura, Port and Harbor Research Institute] 


[Text] 1. Foreword 


Underwater surveys involved in port and harbor construction are conducted 
by divers. However, due to the special working conditions encountered 
underwater, such surveys are risky and their efficiency is low. The demand 
to replace divers with underwater surveillance robots has been heard due to 
the decreasing number of divers and the problems involving working 
conditions since port and harbor construction work increasingly involve deep 
waters. 


To cope with the situation, the Transport Ministry's Port and Harbor 
Research Institute has developed the “Aquarobo,” an axially symmetrical, 
six-legged insent-type program-controlled walking robot, as an underwater 
surveillance robot for port and harbor construction. 


The Aquarobo walks on six axially symmetrical legs, each having three joints 
driven by a DC servomotor. Each joint is mechanically independent and all 
walking activities are controlled by a program. 


Therefore, its walking is not limited. The robot is linked to control 
equipment aboard a mother ship with a cable. 


The robot’s main functions include conducting underwater observation with 
a video camera and measuring the seabed unevenness through walking. It is 
currently designed to walk on rubble mounds comprising the foundation of a 
caisson. 


In FY 1984, the institute manufactured a robot for use in ground experiments 
which had legs half the length of those of the actual model, and conducted 
walking experiments after developing a flat surface walking program.’ 
Improvements were made on the experimental model in FY 1985 and, with the 
development of an uneven surface walking program, the robot successfully 
walked on a rubble mound installed on the ground in FY 1986. 
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We also experimentally manufactured a water-tight leg and a manipulator for 
an underwater video camera in FY 1985. With them, we developed the water- 
tight experiment model shown in Photo 1 [not reproduced] in FY 1986. Based 
on these achievements, we conducted successful underwater walking 
experiments using the water-tight model in the following fiscal year.** We 
simultaneously conducted research to make the robot smaller and lighter, and 
designed and produced a lightweight water-tight leg with an improved joint 
structure in FY 1986 and a lightweight water-tight experimental model in 
FY 1987. 


The practical model to be manufactured in the near future will be able to 
dive to a depth of 50 meters and will be used to inspect the flattened 
surface of rubble mounds, including measuring unevenness, monitor caisson 
installation work, and study and measure damage to marine structures at 
deep-water port construction sites, such as Kamaishi port where breakwaters 
are being built. 


This paper outlines the research conducted since FY 1985. 
2. Control Program 
(1) Outline 


The Aquarobo’s walking activities have all been accomplished through 
software. Therefore, the robot’s performance depends directly on the 
performance of the control program used. 


The control program is hierarchized into a control system program and a 
walking algorithm program. As an interface for the walking algorithm 
program, the control system program contains so-called robot language. The 
robot language is designed for real-time linear interpolation and pulse 
synchronous output to permit the transmission of instructions for leg 
operations by orthogonal coordinate systems. 


The control program is a dialogue-type program and the operator needs only 
to select an operation mode from the menu, then input the walking direction 
and distance for a straight walk and the angle of rotation for turning on 
@ particular spot. The robot leg conditions are graphically displayed so 
that the operator can determine the attitude of the robot. 


The languages used are BASIC and a machine language. 


(2) Walking Patterns 


The Aquarobo’s standard walking pattern is generally a three-leg alternating 
walk. It can also walk in special patterns with different combinations of 
raised and ground-touching legs. The walking patterns are as follows: 














1) Standard Pattern (three raised legs and three ground-touching legs) 


Every other leg operates as # group of three, each group alternately. The 
walking speed is the highest. 


2) Special Valking Pattern (two raised legs and four ground-touching legs) 


Since at least four legs are always touching the ground, this pattern can 
handle a larger load and features higher stability than the standard 
pattern. The stability is similar to that of an cight-legged robot in a 
four-legged alternating walk mode. 


3) Special Valking Pattern (one raised leg and five ground-touching legs) 


At least five legs always touch the ground to support the maximum load and 
offer maximum stability. The traveling speec, however, is low. 


4) Special Walking Pattern (one raised leg and four ground-touching legs) 


In this pattern, the robot walks on only five legs. Equipped with a sensor, 
the remaining leg can be used as a hand, eliminating the need to add another 
manipulator. Since a leg also serves as a hand, we call this the octopus 
function. 


5) Special Walking Pattern (one raised leg and three ground-touching legs) 


The robot walks on only four legs. Even if one or two legs were to become 
inoperable during an underwater operation, the robot could continue to carry 
out the mission. 


(3) Program Functions 


To obtain the maximum performance of the articulation-type walking robot's 
characteristics, the control program has several functions. 


1) Unevenness Measuring Function 


The Aquarobo walks on an uneven surface, using a ground sensor attached to 
the end of each leg. This enables the operator to know the ground surface 
configuration from leg movements. Unevenness is measured by totaling the 
movements of the end of a leg from one position to the next position and 
obtaining the relative geographical relationships between the positions. 


A major advantage offered by a walking robot is that it not only travels on 
legs, but elso measures the unevenness of the ground surface it covers. 


2) Lag Operation Range Extension Function 


Walking generally requires the tip of the leg to move either horizontally 
or vertically on the sides of a rectangle in a linear manner--the leg must 
be raised, moved forward, lowered to the ground and then moved backward. 











However, since the range of operation of the tip of an articuleting-type leg 
is enclosed in a circle, as shown in Figure 1, an unlimited number of 
rectangl«s exist within that range. 




















Figure 1. Foot Operation Range 


Initially, therefore, we selected one rectangle beforehand as the range of 
operation. However, selecting a rectangle poses a problem under this 
method. When the rectangle ABCD is selected, making the strides longer for 
a faster walking speed, the robot raises its legs lower and can cover only 
less uneven terrain. When the rectangle AEFG is selected, allowing the 
robot to raise its legs higher, the stride becomes shorter and the walking 
speed slower. Therefore, this method does not permit the effective use of 
the legs’ range of operation. 


We abandoned the idea of selecting a rectangle beforehand and opted to 
select the optimum rectangle for each step according to the terrain. This, 
however, involves complex calculations because the lurgest rectangle 
possible must be chosen within a three-dimensional space enclosed by a 
sphere since the legs’ rectangles are not independent of each other and the 
legs touching the ground must operate in the same direction in 
synchronization. The weighing of the stride and the height to which the 
legs should be raised poses another provlen. 


Therefore, we developed another method under which the broken line in 
Figure 1 represents the lowest position of the legs. For exemple, when the 
legs are to be lowered along the straight line AE, the rectangle becomes 
AEFG and the stride, EF, will be short if the unevenness is great, with the 
legs not being permitted to touch the ground until they are lowered to the 
lowest position E, however, the rectangle will become ABCD when the legs 
touch the ground at B, making the stride longer. Therefore, the range of 
the legs’ operation can be used efficiently in accordance with the position 
where the legs touch the ground. 


The advantage of this method is that an appropriate setting of the curve 
minimizes the unusable range and, at the same time, weighs the stride and 
the height to which legs can be raised. The range of the legs’ operation is 
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actually three-dimensional space, but virtually the largest rectangle for 
a leg’s next move from its current position can be calculated from the shape 
characteristics of the range of leg operation and restricting conditions. 


Since the method allows the leg operation range to be changed according to 
the terrain, actually providing a range-extending effect, we refer to it as 
the leg operation range extending function. 


3) Ground Retouching Function 


If a leg cannot touch the ground during walking, even when it is lowered 
completely, the robot judges it is impossible to touch the ground at that 
point and lowers the leg to another point. When the robot fails to touch 
the ground with a leg after several trials at different points, “ground 
touching impossible” will be displayed on the screen and the display will 
return to the menu. 


4) Body Inclination Changing Punction 


Usually, a walking robot walks, aaintaining its body level. It is necessary 
to return the body to a level position when it is inclined due to the 
slipping of a leg or the collapse of the ground. 


The body inclination changing function changes the inclinaticn of the body. 
In our program, the center of gravity is regarded as the center of motion, 
so that no shift in the center of grevity of the robot body will occur. 


It is important to note that, in changing the attitude of a walking robot, 
relative positional relationships of the ground-touching legs must not be 
changed. Calculation becomes complex, especially when the robot is walking 
on an uneven surface. 


Initially we calculated the XY-direction inclination correcting angles 
separately and totaled them as a simple calculation method, but the end of 
the legs slipped, indicating that errors could not be ignored. 


The direction of the body's largest inclination generally crosses the body's 
XY axis if not at right angles when projected onto a horizontal surface. 
Errors were caused because the inclination sensors were attached in the XY- 
axis direction of the body and X- and Y-direction inclination correcting 
angles were not independent of each other. 


Therefore, we developed a formula to analytically determine the direction 
and size of the body’s largest inclination from information obtained by the 
sensors, and solved the problem by controlling the legs through coordinate 
transformation in the direction of the largest inclination by using the 
precise answer obtained from the formula. As a result, the legs stopped 


slipping. 























5) Inclined Valking Punction 


The inclined walking function permits the robot not only to maintain the 
body level, but also to keep the body inclined at a desired angle while 
walking. The robot sometimes cannot walk on a slope, maintaining the body 
level, because the legs hit the ground. In such a case, the robot can walk 
by inclining the body in the direction of the ground inclination. 


However, such a move causes a shift in the center of gravity to occur in 
robots controlled by a coordinate system fixed to the body, and it is 
necessary to avoid this shift by employing the limited movable range walking 
mode, or the inverted trapezoid walking mode for four-legged robots.’ 


This problem can be solved by setting the control coordinate system in the 
perpendicular and horizontal directions irrespective of the body's 
inclination. This solution involves difficulties in controlling walking 
robots controlled by a rectangular coordinate system fixed to the body 
because coordinate transformation is required. However, the progran- 
controlled Aquarobo requires coordinate transformation and little change in 
control complexity occurs. 


6) Walking Parameter Estimating Function 


Parameters for walking, such as the stride, the height the legs should be 
raised, the height of the body and the inclination of the body, are 
generally set by the operator beforehand and remain unchanged during a walk. 
However, when the robot travels on a changing terrain, e.g., from a slope 
to level ground, it can walk efficiently without making useless leg 
movements if the parameters are changed in accordance with the ground 
conditions. 


The walking parameter estimating function determines the extent of 
unevenness from the legs’ positional relationships by using the unevenness 
measuring function and automatically selects the optimum walking parameter 
values, employing the inference algorithm. This function includes a 
decision to determine whether the leg separation range extension function 
and the inclined walking function should be employed. 


3. Improvements of Land Experiment Model and Walking Experiments 
We improved the land experiment model manufactured in FY 1984, including a 
change in the leg structure and the installation of various sensors, 
enabling it to walk on a rubble mound-like uneven surface in 1985. 


Table 1 shows the specifications of the land experiment model after the 
improvoments. 


(1) Walking Experiment on Rubble Mound 
We conducted walking experiments on land on a roughly and fully leveled 


rubble mound to study the walking performance of the land experiment model 
and the adequacy of the control program. 
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Table 1. Specifications of Land Experiment Model (Improved) 








Robot 

Type Axial-symmetrical six-leg walking insect type (with 
three joints for each leg) 

Driving systen DC servomotor semidirect drive 

Control Program controlled by personal computer 


Unevenness covered 


Major material 


Veights 
Dimensions: 


Number of joints 


Sensors used 


717.5 ca 


Corrosion-proof aluminum 


280 kgf 


Body: hexagonal column with each facet measuring 
16 (H) x 25 x 258 
Leg length: Body side: 25 ca 
Foot side: 50, 55,60 cr 
Foot diameter: 16 cm, ankle movable angle: 245 
degrees (all around) 


18 for legs, 1 for obstacle sensor supporting arn, 
19 total 


6 tactile sensors (leg end) 

6 eight-part tuctile sensors n sole (foot) 

6 foot-side tactile sensors (foot) 

2 inclination sensors, 1 azimuth sensor (body top) 
1 obstacle sensor (tip of arm) 





Control equipment 





Dimensions 


Front panel 


Computer 
Others 


1,710 x 2,050 x 810 = 

Termiuels and displays for joint voltage, 
inclination sensor, azimuth sensor, and obstacle 
sensor readouts 

16-bit personal computer (CPU: 186086) 


Joint torque sensors (for the second joints) and 
encoder counters 





The rubble mound used for the experiments consisted of a level section, 

3 m wide and 6 = long, and « slope with a 25-percent inclination. The sound 
was manufactured by divers actually engaged in leveling work and used rea! 
rubble. The leveling precision was £5 cm for full leveling, the same es 
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that of actual rubble sounds, and 115 ca for rough leveling, half that of 
actual mounds since the leg length of the experimental model was half that 
of the practical model's legs. 


Based on the results of preliminary experiments, we manufactured robot feet 
of the optimum shape and size for rubble mound walking and replaced the 
original feet with the new ones. They are 25 cm in diameter and the base 
is flat and rubber-coated. 


The robot proved capable of walking problem-free on a roughly leveled 
surface. Walking speeds depend on the stride anc the height to which the 
legs are raised. In the experiments, the maximum speed was about 1.7 = per 
minute, with the joint rotating speed set at a quarter of the saxinun 
operating speed. The walking speed increased as the joint rotating speed 
was raised, but we did not increase the speed any further in the experiments 
due to inertial mass pro‘lems and the reliability of the ground touching 
sensors and also because th: robot cannot walk as fast in water as on land 
due to fluid resistance. 


The inclined walking and walking parameter estimating functions were added 
to the control program based on information obtained from the experiments. 
The inclined walking function enabled the robot to walk on a 25-percent 
grade, which had previoucly been difficult. Photo 2 [not reproduced] shows 
the robot covering the grade. The walking parvmeter estimating function 
slashed the time required for ascending a slope to about one-third the 
previous time. 


The experiments demonstrated that the Aquaboro can walk autonomously, 
selecting optimum walking parameters through program control, on ground with 
unknown terrain. Particularly notable is that it was able to climb up and 
down a slope with an uneven surface on its own, and we believe we have 
cleared one of the hurdles for the development of a practical use walking 
robot. 


(2) Durability 


The land experiment model was displayed at “Tohoku’s Future Exhibiticn” held 
in Sendai, Miyagi Prefecture, from July to September 1987, where it 
demonstrated its walk, using various walking patterns, on a flat surface and 
a simulated rubble sound. 


Although some minor probleas occurred the robot was inoperable for only 

2 days, in September, of the 73-day run of the exhibition. The problem was 
caused by a cable conmecting the body and the legs and had nothing to do 
with the robot's sain mechanisa. 


We think the land experiment model proved sufficiently durable in view of 
the fact that although brand-new walking robots are usually displayed at 
science exhibitions, our robot had slready been used in experiments for 

2 and 1/2 years. 











4. Manufacture of Vaterproof Experimental Model and Underwater Experiments 


We experimentally-manufactured one waterproof leg in FY 1985, and based on 
the results of experiments with it, we manufactured a waterproof 
experimental model in FY 1986. Signal transmission is done by optics, snd 
the robot and control equipment are connected by an optoelectronic composite 
optical fiber cable. The robot has photoelectric converters within the body 
and the cortrol equipment. Multiplexing is used for signal transmission to 
reduce the number of optical fibers used. 


Table 2 shows the specifications of the waterproof experimental model. 
(1) Robot 
The leg length of the robot is double that of the land experiment model. 


The shape and major dimensions are shown in Figure 3, while Photogragh 3 
[mot reproduced] shows both models for purposes of comparison. 











Teetile 
eeneor 


Figure 3. Shape and Major Dimensions of Waterproof Experimental Model 





On the top of the body, we insiailed the manipulator for an undervater video 
camera manufactured in FY 1985. The manipulator has 3 degrees of freedom 
and weighs about 70 kg, excluding the camera, on land. In order to widen 
the vision of the video camera, we employed the joint direct drive systes, 
the same as that for the robot's ‘egs, without using the link system that 
has a restricted range of motion and is difficult to make waterproof. 











Table 2. Specifications of Waterproof Experimental Model 





Robot 





Type 


Driving systen 
Control 

Unevenness covered 
Waterproof 

Major material 
Weight 


Dimensions 


Number of joints 


Sensors used 


Axial-symmetrical 6-leg walking insect type (with 
3 joints for sach leg) 


DC servomotor semidirect drive 

Program control by personal computer 

+35 ca 

To depth of 50 =» 

Corrosion-proof aluminum 

689 kgf (on land), 320 kgf (in water) 

Body: 77-cm high cylinder with 50-cm diameter 
Leg length: Body side 50 cm, foot side 100 cm 
Foot diameter: 25 ca 

Ankle movable angle: 145 degrees (all around) 
18 for legs and 3 for manipulator, 21 total 


6 tactile sensors (leg end) 

2 inclination sensors, 1 azimuth sensor (inside 
body) 

1 depth sensor (lower body) 





Control equipment 





Dimensions and weight 


Front panel 


Computer 


Optoelectric conver- 


sion equipment 


1,230 x 1,600 x 800 mm, 250 kgf 

Terminals and displays for joint voltage, inclina- 
tion sensor, azimuth sensor, and depth sensor 
readouts 

16-bit personal computer (CPU: 180286) 


1 for TV picture signals, 5 for encoder signals 
and 1 for sensor signals 





Composite cable 





Dimensions 

Unit weight 
Specific gravity 
Allowable tension 


42 mm (diameter) x 100 m (length) 

1,660 g/m (on land), 370 g/m (in water) 
About 1.28 
1,500 kg 














The actuators for the first and second joints from the base of the 
manipulator are piaced close to the base in order to increase the load that 
can be handled. The first joint is doughnut-shaped, with cables going 
through the central hole so that they will not interfere with the 
manipulator’s movement while it is turning. 


Waterproof magnetic proximity switches were adopted for ground-touching 
sensors so that they could operate at constant force irrespective of the 


depth. 


As for the robot feet, we used the same shape and measurements as those used 
by the land experiment model for rubble mound walking experiments. The 
underwater model is not equipped with eight-part touch sensors for the foot 
bottom and touch sensors for the side section since such sensors cannot be 
used under water. 


(2) Control Equipment 


We made the control equipment compact for easy loading on the mother ship. 
The adoption of a small servo driver and an overall review of the 
configuration shrank the control equipment size to about one-third that of 
the land model’s in terms of volume, despite the fact that it has a built- 
in photoelectric converter and interface box. Photograph 4 [not reproduced] 
compares the control equipment for the land and underwater models. 


(3) Tank Experiments 


We conducted underwater walking experiments on the waterproof experiment 
model in a tank, as shown in Photograph 5 [not reproduced]. 


In the walking experiments in the tank, we studied a decrease in the walking 
speed due to fluid resistance and an increase in required joint torque on 
a flat surface. the maximum walking speed in the tank has reached about 
1.4 m per minute so far. 


In underwater walking, the walking speed is limited by the robot’s inertial 
mass and fluid resistance. The feet slipped when the walking speed during 
a straight walk was increased, although no problems occurred in pivoting on 
the spot. This indicates that inertial mass affects the robot’s walk more 
than fluid resistance does. For the time being, we plan to cope with the 
problem by optimizing the time constant of the servodriver. In order to 
increase the walking speed, we think it is necessary to make the robot 
smaller and lighter. 


(5) Undersea Experiments 

Using the waterproof experimental model, we carried out undersea experiments 
in december 1987 in the Yasuura area of Yokosuka Port. Photograph 6 [not 
reproduced] shows the robot during an undersea experiment. 


Walking experiments were conducted on an actual rubble mound at a depth of 
5.5 m to confirm the robot's walking performance under actual conditions. 
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The robot carried an underwater video camera with an ultrasonic range finder 
and an underwater position finder to evaluate the entire systen. 


Equipped with the ultrasonic range finder and an optical system designed 
specifically for underwater use, the video camera can measure the distance 
to a subject. Horizontal and vertical scales are superimposed on the 
screen, and it can measure the subject's size with a cursor, wit! its 
calculations based on the picture angle. 


The underwater position finder is an LBL-system ultrasonic transponder. 
Consisting of one main station and three substations, it can measure the 
robot's three-dimensional position. It uses linear frequency modulated (FM) 
signals, seldom used in the audio field, as the carrier, and adopts the 
pulse compression method for frequency modulation to reduce multiple 
reflection. As a result, it offers the high precision of 110 cm for a 
distance of 300 a. 


For the undersea experiments, we manufactured a reel that can take up the 
optical fiber cable, without twisting it, as a support systen. 


We conducted 10 walking experiments at a speed of one-eighth of the maximum 
walking speed, and generally obtained good results for the walking and 
unevenness measuring characteristics. Pictures sent from the video camera 
attached to the manipulator did not shake during the robot's wa\k, attesting 
to the fact that the waterproof experimental model could maintain the 
levelness of the body while walking. The robot sometimes caught its feet 
between rubbles. Therefore, the foot shape needs to be improved. 


We also checked the performance of the video camera equipped with the 
ultrasonic range finder and the underwater position finder, and they proved 
to provide the required performance. 


Based on the results of the underwater walking experiments, we are improving 
the waterproof experimental model for practical use. We manufactured floats 
to help reduce the impact on the robot when it is dropped into water and 
hits the sea bottom, and replaced the robot's magnetic azimuth finder with 
@ gyroscope-type one. We also plan to boost the output of the joint 
actuators and improve the foot shape. 


5. Conclusion 


Walking robot research has progressed from the walking experiment stage to 
that for practical use with specific objectives.1 However, the walking 
robots manufactured so far are actually experimental models, and no robot 
has been made yet for practical use. 


We believe the Aquarobo, which can walk on a slope with an uneven surface 
and has actually walked in a natural environment under the sea, most closely 
approaches a commercial-use model. 


The development of the Aquarobo, which began in FY 1984, has entered its 
final phase, and the improved waterproof experimental model is scheduled to 
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undergo practical use tests in Kamaishi Port at a depth of more than 30 a 
during FY 1988. We hope to solve the problems that remain before it can be 
uzec¢ in actual harbor work through tests and further improvements. 
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Control of MELCRAB--Stair-Climbing Six-Legged Mobile Robot 


43064062 Tokyo 4TH INTELLIGENT ROBOTS SYMPOSIUM PAPERS in Japanese 
13/14 Jun 88 No 104 pp 27-32 


[Article by Noriho Koyauchi and Adachi Hirotsuke, Mechanical Engineering 
Institute; and Aji Nakano, Tohoku University] 


[Text] 1. Introduction 


Many studies of legged mobile robots have focused on the complex control of 
degrees of freedom through multijoint leg structures.’ However, during a 
quiet walk with three or more legs always touching the ground, the legs 
form a mechanically closed loop via the ground surface, causing mechanical 
interference among them. Just as in controlling multiple manipulators or 
fingers, spatial interference, that is, a collision, of the legs must be 
avoided for a walking robot. To continue a smooth walk, it is necessary to 
select a walking mode that will ensure that the supporting polygon’ formed 
by the supporting legs continuously contains the center of gravity. The 
redundancy in the degree of freedom is designed to cope with varied walking 
environments, but the load of the control program tends to become larger 
during basic walking operations than when dealing with terrain conditions. 
An energy loss also tends to be caused by dynamic interference and 
relationships between the leg mechanism and dead load support counterforce. 
The Mechanical Engineering Laboratory has been conducting research and 
development of the MELCRAB-1° (Figure 1 [not reproduced)), a six-legged 
mobile robot, and the MELCRAB-2* (Figure 2 [not reproduced]) to solve these 
problems involving the basic walking movements of machines and to increase 
the control of terrain adaptation, particularly the descending and ascending 
of stairs. This paper discusses the basic configuration of such control. 


2. MDA and Pseudolinear Mechanism 


It is known from analyses of the walking patterns of insects that the 
alternate three-point grounding method provides the fastest walking speed 
in hexapod walking machines.’ The gravitationally decoupled actuator (GDA) 
has been proposed to curtail the energy loss which occurs during walking by 
separating the legs’ degrees of freedom in gravitational and horizontal 
directions .® 
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We adopted the motion decoupled actuating (MDA) method under which the 
horizontal propelling of the mobile unit and the adaptation to a rough 
ground surface are accomplished by mutually noninterfering different degrees 
of freedoms.’ Under this method, the mobile unit’s motion is divided into 
propelling motion and terrain adapting motion, and totally different degrees 
of freedom constitute and drive each category. The leg conditions during 
walking are generally classified into the standing-leg and idle-leg phases. 
In the standing-leg phase, the ground-touchir~ voint does not change until 
the next step and a mechanically closed loop i ‘rwed among the robot body, 
leg and ground, as explained earlier, requ:..., complex control. The 
relative motion of the ground and body, however, can be reduced to one- 
dimensional motion. By contrast, in the idle-leg phase the leg must touch 
the ground in accordance with the terrain configuration, but it will not 
interfere dynamically with other legs due to the open link. A cyclic motion 
generally dominates the walking motion, as shown by animal locomotion, and 
in many cases terrain-adapting action is taken as a fine adjustment measure 
when an idle leg touches the ground. Therefore, no mchanical interference 
among the legs will occur when a cyclic return motion of the standing-leg 
phase trajectory and the idle leg is achieved by mechanically coupling the 
legs. It is also thought possible that the motor’s motion energy loss can 
be lessened by fixing the propelling motion to the mechanically drawn 
trajectory. 











Figure 3. Approximately Straight Line Mechanism 


The approximately straight line mechanism’’* shown in Figure 3 was adopted, 
based on these ideas, for the robot body propelling motion. It is called 
Chebyshev’s approximately straight line mechanism and generates a locus 
quite suitable for walking, as shown in the figure. This approximately 
straight line section is used for the horizontal direction of the GDA, while 
the rack-and-pinion direct-drive extension/retraction mechanism, shown in 
Figure 4, is employed for the perpendicular direction. 


3. Control Hardware Configuration and Hierarchical System 
Figures 5 and 6 show the control system configurations of the experimentally 


manufactured MELCRAB-1 and MELCRAB-2. The MELCRAB-1 has potentiometers, 
tachogenerators, rotary encoders, and attitude sensors as internal sensors, 
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Figure 4. Mechanism for Leg-Extension or Retraction 
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Figure 5. MELCRAB-1 Control System 


and analog touch sensors at leg ends and ground touching sensors on the 
soles as external sensors. Im the MELCRAB-2, the analog sensors were 
replaced with optical digital sensors and infrared proximity sensors were 
added to detect objects before being hit by the legs. The first thing we 
wanted to avoid was the attitude giving way when the body goes up and down 
due to the extension and retraction of the legs. Therefore, both the servo 
driver unit in Figure 5 and motor driver in Figure 6 have analog velocity 
feedback circuitry with tachogenerator voltage feedback. This is the 
hardware that constitutes the lowest level of the hierarchical contro). 


systen. 


Walking robots generally have a hierarchical control system because they 
have many independent degrees of freedom.**"' Different types of high-level 
control systems, including motion commands from the operator, interfaces and 
terrain surveillance using machine vision can exist. Since external sensors 
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Figure 6. MELCRAB-2 Control System 
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are used only as leg sensors in the experimentally manufactured models due 
to sensor installation conditions, the hierarchical structure of the control 
system will be similar to that shown in Figure 7. A velocity feedback servo 
mechanism, made up of analog circuits, which is most close to hardware, 
constitutes Level 0. Level 1 involves the position control of the body 
propelling and leg extension/retraction motions, providing the software 
servo is based on values given by rotary encoders or potentiometers. 
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Figure 7. Hierarchical Control System 


The output is the command voltage of the Level 0 analog circuits. The input 
of tactile sensor signals and adapting motion control, such as the leg 
grounding and stoppage accomplished by sensor signals and position control, 
are on Level 2 and constitute a factor of Level 3. In the control program, 
Levels 1 and 2 together form a subprogram. On Level 3, the top level, 
terrain adapting control tactics, which will be explained later, are found. 
Currently, the operator's motion commands are the sole input to this level 
and its parameter is the number of steps. 
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4. Leg Position and Speed Control 


Due to the adoption of the approximately straight line mechanism and the 
MDA, the leg position and velocity control on the lowest level ‘equire no 
complex trajectory generation. We adopted the semi-software servo loop, 
consisting of anrlog velocity control and digital position control, shown 
in Figure 8. th. position control for an approximately linear motion are 
noncontinuous val:‘es since the sensor input is executed by rotary encoders. 
Therefore, we decided to carry out control through a transformation into 
relative coordinates which contain the target position as a positive value, 
with the initial position set as the origin for each step. Under this 
position and velocity control, the target position and maximum velocity 
while traveling to that point are given as command values. Continuous 
control of the trajectory is not required due to the velocity feedback servo 
mechanism of the analog section, and PTP control suffices. 























Figure 8. Semi-Software Servo Loop for Position and Velocity Control 
5. Terrain Adapting Control Tactics 


5.1 Obstacle Avoidance Control™ 


One of the ways to cover rough terrain by using tactile sensors is simple 
obstacle avoidance. The tactile sensor on each foot is monitored constantly 
and the body propelling motion is suspended when an obstacle is detected, 
with obstacle avoidance actions taken repeatedly by retracting idle legs or 
extending supporting legs until the sensors no longer detect the obstacle. 
Upon completion of the avoidance operation, the body propelling motion 
resumes. The obstacle avoidance control is applicable not only to stairs, 
but also rough terrain surfaces. Figure 9 shows the foot trajectory in 
obstacle avoidance control during stair climbing. 


5.2 Stair Dimension Learning Control” 


When the surface to be covered is a combination of a flat area and stairs, 
it is possible to change the foot trajectory by learning stair dimensions 
from tactile sensor information, making use of the regularity of the stairs. 
The robot walks on a flat surface with the body propelling motion using the 
approximately straight line mechanism and, when it detects an cbstacle, it 
assumes that the obstacle is a staircase. With the initial tactile 
information, the robot learns the position X, of the first step of the 
stairs, and with the next batch of tactile information it learns the 
position of the second step and, at the same time, calculates the depth d 
of the step. In six-leg grounding, in which idle legs become standing legs, 
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Figure 9. Foot Trajectory in Obstacle Avoidance Control 


the step height h can be calculated. Since it is possible to use X,, d, and 
h to predict the edge of the stair step the robot will encounter in its next 
step, the robot can climb the stairs without stumbling by simultaneously 
carrying out the body propelling motion and terrain adapting motion (leg 
extension/retraction) by setting the target value at a point slightly higher 
than the edge. in the obstacle avoidance control explained ir. 5.1, the body 
propelling motion ceases frequently because the six legs touch the stairs 
with every step. The more frequent the stop-avoidance-reacceleration 
procedure is utilized, the slower the traveling speed of the robot becomes. 
In stair dimension learning control, however, the robot stops only at the 
first stair step. After calculating the stair dimensions, the robot can 
climb the stairs at a speed close to that of a flat surface walk because no 
sensor touches the stairs except when the standing legs are changed. Figure 
10 shows the foot trajectory in stair dimension learning control. 





Figure 10. Foot Trajectory in Stair Dimension Learning Control 


6. Synchronization Control of Two Body-Propelling Degrees of Freedon™* 


Landing points cannot be changed in the MELCRAB-1 because the approximately 
straight line mechanism of all six legs is mechanically linked. As for the 
MELCRAB-2, we made a landing point change possible when two sets of three 
legs exchange roles in the alternate three-point landing pattern by driving 
the two groups of legs with separate motors. The MELCRAB-2 requires a 
control program for idle and supporting leg synchronization, which is not 
needed for the MELCRAB-1. Figure 11 shows the servo mechanisa of the 
control. Im the figure, én and és are phase angles of the input axis of the 
approximately straight line mechanism that carries out the synchronization, 
and represent the saster and slave, respectively. Driving must be done with 
the slave angle targeted at a value 180 degrees phase-different from the 
master angle. Input parameters are the master angle’s target value ém and 
its maximum speed @m. The master is PTP-controlled from its original 
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Figure 11. Block Diagram of Synchronization Control of Two 
Body-Propelling Degrees of Freedos 


position as opposed to the target value, while continuous value control is 
used for the slave, with target values set at the master’s present position 
and maximum speed. Limiter 2 in Figure 11 is provided to prevent giving 
commands for excessive speeds, averting having the slave being driven in the 
opposite direction from the master. From the viewpoint of stabilization 
during walking, we concluded that the supporting leg group should serve as 
the master and the idle leg group as the slave. Figure 12 shows the results 
of a synchronization experiment involving two body-propelling degrees of 
freedom. Figure 12(a) shows the input angle of the approximately straight 
line mechanism, with the broken line representing @m and the solid line @s. 
The chain line represents the difference between the slave's target value 
and the present value, with os © (én + « = #8). Figures 12(b) and (c) show 
the command voltage output value from the digital/analog (D/A) converter to 
the analog velocity feedback circuit and the tachogenerator voltage, 
ery 5 apt ae with the broken line representing angle velocity @ and the 
solid line @s. The experiment was conducted using the initial values of 
6m = 3/4 « and @s0 = 3/2 = and the stop target values of #m = 3/2 « and 
ésa =~ «/2. It is clear from the figures that the idle legs catch up with 
the standing legs through quick acceleration. When the slave is trying to 
catch up with the master, the command voltage is Limited to ésii, the upper 
ceiling shown in Figure 11. In the Figure 12 experiment, ésism = 2 dma. 


As shown in Figure 12(b), excessive acceleration is avoided by increasing 
the command speed for alternating current from the original position to the 
maximum speed almost proportionally, in addition to proportional control 
near the target position. Since no interrupt control using a lock is 
employed in the MELCRAB-2's control system, the time-proportional 
alternating current generally used is not possible. instead we used the 
value obtained by sultiplying the travel distance from the initial position 
by a gain and adding a constant as the command speed. 


7. Conclusion 
Since the MELCRAB-1 and MELCRAB-2 hexapod sobile robots use the 


approximately straight line mechanism and the MDA, they can walk without 
requiring complicated calculations for trajectory and gait plans for each 
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Figure 12. Synchronization Experiment of Two Body- 
Propelling Degrees of Freedosa 


leg. This paper discussed the basic structure of the robots’ control, the 


stairs/rough terrain walking algorithe using tactile sensors and 
synchronization control for the MELCRAB-2. 


We are now studying how to apply learning control using tactile sensors, 
used for stair climbing, to walking on general rough terrain areas. 
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Dynamic Walk Pattern of Four-Legged RoSot 


43064062 Tokyo 4TH INTELLIGENT ROBOTS SYMPOSIUM PAPERS in Japav~se 
13/14 Jun 88 No 105 pp 33-38 


[Article by S. Hirose and T. Takagi, Tokyo Institute of Technology; and 
T. Furutani, Yokogawa Electric Works, Ltd.: "Research on Dynamic Walk 
Pattern of a Four-Legged Walking Robot") 


[Text] 1. Introduction 


Walking can roughly be divided into static and dynamic aspects from the 
standpoint of stability retaining. In the former, the center of gravity of 
a walking body is always positioned inside a polygon formed of the 
supporting legs and their soles, assuring static stability, while in the 
latter, on the other hand, it is sometimes found outside the polygon, 
requiring dynamic position-retaining control. 


The authors have been engaged in the systematic study of the static walk of 
a four-legged machine. However, the capabilities of low-speed static walk 
alone are not sufficient to enable such a four-legged walking machine to be 
used as practical, universal moving platform, although it is highly stable. 
Namely, it is indispensable that it also perform dynamic walk that would 
ensure high-speed movement, even though swing would occur. 


Several pioneer research projects have already been carried out involving 
the dynamic walk of walking machines. The main subject of most of them has 
involved the retention of their dynamic position. The authors, however, 
believe that it should not be extremely difficult for four-legged walking 
machines to retain their dynamic position, and that they should be able to 
perform dynamic walking without requiring any large-scale dynamic 

control. If dynamic walk could be performed easily, the machine's computer 
capability could be used to attain a high ground adaptability, significantly 
improving its functions. This paper will discuss the minimum problems to 
be solved to attain dynamic walk from this viewpoint. The appropriateness 
of this concept will be verified experimentally. 
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2. Basic Setting 
2.1 Symbols To Be Used and Their Significance 
The following are the symbols to be used here and their significance: 


acceleration upon starting and completing resetting phase 
duty factor-ratio of supporting phase time to leg unit cycle time 
unit cycle time of reference gait 
resetting speed of legs (relative to center of gravity) 
maximum mechanical value of V, 
gravity center shift speed 
, %, Zp, 2: movement range of legs (Figure 1) 
length of stride (A",.. = x’) 
ascending stride 


FSS SSP e 











Figure 1. Subject Four-Legged Walking Machine 
2.2 Subject Walking machine and Its Gait 


Figure 1 shows a subject walking machine model, as well as its leg movement 
range and coordinate system. Studied here will be dynamic walk to achieve 
normal straight advance on flat ground. Therefore, its y-directional 
freedom is ignored. 


Gait (pattern of leg movement): static walk is based on a crawl gait and 
dynamic walk is based on a trot gait with 0.75 > 6 > 0.5. 


3. Acceleration and Deceleration Taken Into Account in Determining Leg 
Trajectory 


For high-fidelity reproduction of walking movements, the leg trajectory must 
meet certain gait parameters, such as duty ratio, movement speed, leg 


resetting speed, etc. 


When the leg's acceleration and deceleration time is not taken into account, 
the center of gravity V, of a walking machine and the resetting speed V, of 
its legs have the simple relationship represented by: 
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This is derived from the fact that areas S,’ and S,' become equal in such a 
leg speed plan, as shown in Figure 2(a). The leg swing trajectory for 
static walk has been determined in the combination with its relationship to 
z (vertical)-direction movements.’ When the swing speed of the legs is 
increased, however, the target leg trajectory value of equation (1) is not 
practicable since their acceleration and deceleration are not taken into 
account. Therefore, in this chapter a leg trajectory generation method, 
reflecting their effect will be derived. Preconditions for this induction 
are as follows: 


(1) It is assumed that duty ratio f-instruction has been given. 
Instruction is given involving either gravity center movement speed V, or leg 
resetting speed V,, with the other given as its function. 


(2) During the # T-period, while the legs are in the supporting phase, they 
perform equal-speed motion at a speed of -V,, while their swing amplitude 
agrees with length \° of their stride. Namely, 


A" = VST (2) 


(3) The acceleration a or -a time is set up at the beginning and end of the 
resetting phase. The resetting speed obtained is denoted by V._. 
Acceleration a is assumed to be the upper limit value, dependent on the 
actuator output, leg inertia, etc. 


The swing motion of the legs satisfying such a requirement is shown in 
Figure 2(b). As shown in Figure 2(c), the positive speed direction movement 
value (area S,) and negative speed direction movement value (area S,) of the 
legs must be equal. 


s.={ a-a tS }v. (3) 
s.=| ste |v. (4) 





When the resetting speed V, and such parameters as a, T, and # are given, 
therefore, the center of gravity movement speed V, is obtained as follows: 


V," + (afT + 2V,) Vg + V," 
-a@ (1 - £) TV, = 0 (5) 


Vg = -(br + V,) + (By r* + 2V, r)h 
in which (¢ = aT/2) (6) 
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Figure 2. Diagram of Leg Trajectory 


Parameters V,, a, and # in equation (5) are given and depend on the driving 
system performance and target gait. However, period T cannot be specified 
independently. It is generally dependent on fixed stroke \°, so that it 
satisfies the requirements of equation (2). Therefore, the relationship 
obtained when \° is given in place of period T is derived as follows. When 
equation (2) is substituted for equation (5), 


V_? + 2V, Vg" + (V,” + ad") Vg 
- ( (1 - £) / B) ad’ Vv, = 6 (7) 


Vg is a positive real number solution. For equation (7), therefore, only 
one solution can be obtained, as follows: 


Vem (Ati 8) + (A=-FB) + -~ v. (8) 


For some gait generation processes, it is necessary to calculate V, first, 
then the V, of the legs on the basis of V,. It is obtained from equation (7) 
as follows: 


V, = C = (Cy - (Vg" + ad") Dh (9) 
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In this connection, two requirements, i.e., 


Ve < Vewes (10) 
42 Ve" 11 

75 at) 

must be satisfied. Equation (1) represents the requirement that the leg 
resetting speed be lower than the maximum swing speed, and equation (11) 


that in which the maximum free leg phase speed must be the same as the 
resetting speed V.. Figure 2(d) is a diagram of the leg trajectory obtained 
on such a walk. Figure 3 illustrates the leg tip trajectory obtained from 
the body coordinate system under the assumption that a substantially similar 
trajectory plan is being carried out in the z-direction, but with 
acceleration and deceleration taken into account. 
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Figure 3. Leg Tip Trajectory Obtained With Acceleration 
and Deceleration Taken Into Account 


4. Static/Dynamic Transition Valk 


Walking machines must perform high-stability static walk at the beginning 
and end of dynamic walk. They need to engage in dynamic walk during flat 
ground high-speed movement, but in static walk when moving in an uneven, 
unstable environment or during slow inspection. In other words, it is 
indispensable, in the practical application of walking machines, to 
introduce a gait-generating method to enable free dynamic/stable walk 
changeover. No study yet conducted seens to have approached such a 
static/dynamic transition walk generation method involving four-legged 
walking machines. This chapter will, therefore, discuss the basic concepts 
underlying this point. 





The crawl-to-trot gait static/dynamic transition walk will be studied first. 
The easiest transition method involves a continuously decreasing duty ratio 
for more than 0.75 to 0.5. However, this obstructs the actual walk since 
the distance between the supporting legs during the crawl is a function of 
B. For example, the distance between the front legs (leg-1, leg-4) and rear 
legs (leg-2, leg-3) is represented by A°, while that between the left legs 
(leg-1, leg-2) and right legs (leg-3, leg-4) is 2x, + A\°/B. The motion of 
the relative slide of the legs to the ground during the supporting phase, 
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therefore, is necessary for § to vary continuously. This paper introduces 
a method to varying it in accordance with the transition process. 
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Figure 4. Diagram of Static/Dynamic Transition Walk Gait and 
Example of Walk Posture at t = 0 


Figure 4 is a diagram of such a static/dynamic transition gait. Gait 
diagrams express the leg motions as a function of time (t) on the center of 
gravity coordinate system of a body. Figure 4 exemplifies a dynamic walk’s 
posture when time (t) = 0. A method for determining the static/dynamic 
transition gait will be described here. It must satisfy the following 
requirements: 


(1) Transition process: from when either (Figure 4: i = 1) of the front 
legs (i = 1,4) begins the resetting operation until it returns to the 
transition starting position. 


(2) The resetting period V, of the legs does not change before, after or 
during the transition period. 


(3) The front leg (i) begins resetting at transition start time t, and 
completes it at time t, (= t, + T,). In the meantime, all the other legs 
have the same transition phase speed -Vg,. It is specified that, after time 


t,, the relationship between the positions of the front legs corresponds to 
that of the duty ratio obtained after transition. Namely, 


Vae — (Ver Vee) (12) 


(4) After time t,, che supporting legs take supporting leg phase speed V,, 
after transition. 


(5) The leg positioned diagonally with respect to leg (i) (Figure 4: 
leg-3) starts resetting at time t,, earlier by stroke A, given as: 


@ (foam) Ps Var Pes (13) 
bye (1m) PVT 
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so that the resetting motion is completed at time t,. 


(6) The rear leg on the same side as leg (1) (Figure 4: leg-2) begins 
resetting at time t,, earlier by stroke 4,, as given by: 


4, * * e Vet: S T, + Tas) Vea (15) 
where 


Ta = |{ (T; + T,) v. VoeT 
- VosT2 ) / (Vag + Vy) (16) 


so that the resetting motion is completed at time t, when the transition 
period expires, and in which the following parameters are present: 


th (17) 
Vou 
vee Ghutes Vee (18) 


A leg acceleration/deceleration reflecting gait diagram is obtainable when 
Figure 2(d) is used in addition to Figure 4. In this static/dynamic 
transition walk, the center of gravity transition speed discontinuation 
points correspond to time t, and t,. Theoretically speaking, infinitely 
large acceleration occurs at that time. However, the posture obtained 
immediately thereafter is a static-stability-maintaining three-legged 
supporting state. Instantaneous acceleration, if any, exerts a small 
influence on the walk. This gait plan based on Figure 4 is, therefore, 
believed to be sufficiently practicable for the static/dynamic transition 
walk, although it includes approximate values. 


We have discussed the transition from static to dynamic walk in terms of the 
increasing direction of duty ratio 8. The same theory is applicable to the 
transition from dynamic to static walk with # increasing in the opposite 
direction. In this case, the adjusted strokes 4,, 42 of the rear legs extend 
toward the rear upon transition, taking a negative value. Usually, 
therefore, it is necessary to walk so that stroke \° has a lower value than 
that of the mechanical limit value x". 


5. Posture Control in Dynamic Valk 
5.1 Importance of Posture Control 
It has generally been believed that the most important point in walking 


machines’ dynamic walk is retaining the dynamic stability, and the study of 
dynamic walk has been equated with that of dynamic stability control. 
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Certainly, in most cases of two-legged walk, the loss of dynamic stability 
leads directly to falling, i.e., dynamic stability must be maintained. 
However, the authors would iike to point out that the dynamic stability of 
a four-legged walking machine is not difficult to control during dynamic 
walk. The following are reasons for this: 


(1) When a four-legged walking machine is walking dynamically, its two free 
legs perform most of the resetting motion along the transition plane, even 
during the two-legged supporting phase. It does not fall down completely, 
even when losing its dynamic stability or balance. 


(2) During dynamic walk, the center of gravity, i.e., ZMP (zero moment 
point),° of a dynamic body exists near a polygon (line segments formed by 
legs-2 and 4), as shown in Figure 5, formed by two diagonally-located 
supporting legs. Even if it falls down, i.e., it is not able to maintain 
dynamic stability so front leg-1 or rear leg-3 touches down at another point 
than that originally specified, the greater part of the walking body load 
obtained then is supported by legs-2 and 4. Leg-l or 3 can easily slide 
along the ground due to its low ground contacting pressure, i.e., it returns 
easily to its original gait pattern, even after losing its balance. 





Figure 5. Relationship Between Supporting and Free 
Legs During Dynamic Walk 


The dynamic walk of a four-legged walking machine has, up to now, been 
believed to require sophisticated, large-scale control. However, as 
described above, it is now thought to require only simple control. This is 
believed to be significant for the practical application of walking 
machines. 


5.2 Quantitative Examination 


The study results described above will be quantitatively examined through 
the computer simulation of a four-legged walking machine with simplified 
operation. It has been conducted to estimate varying the center of gravity 
ZMP of a four-legged walking machine with a pantograph leg mechanism of the 
same shape and size as that of a machine model described later when 
performing dynamic walk involving moving the body horizontally at a constant 
speed. Assuming that the body is performing constant motion at a constant 
speed, the dynamics of the whole structure of the walking machine can be 
calculated by inducing and combining that of each of the four legs. 


The simulation was carried out as stated below. First, the kinetic solution 
of various parts of the legs was calculated under the assumption that they 
perform cyclic motions as described in Chapter 3, and the force (Figure 6) 
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required for application to the leg joints in order to generate a target 
trajectory was calculated through counterdynamic analysis using the Newton- 
Eulerian formula. Then, the forces -f,, -f,', and -f,, which each of the 
four legs applies to the body, could be calculated. Their sums were 
determined, and the force and moment working on the body’s center of gravity 
during walking were derived. ZMP was then derived using these values. 
During this calculation, the values of the forces generated by the x- and 
y-axial drive systems were obtained. An example of this is shown in 











Figure 7. 
= u-axial drive force 
h_ Z 
J 
aa t te) 
Figure 6. Link and Joint Force Figure 7. Variation of Calculated 
Vectors of Pantograph Value of Force Generated 
Leg Mechanisa by x- and y-Actuators 


Figure 8 shows the path projected to the movement plane of the calculated 
value of the ZMP during one walk cycle with duty ratio §, indicating the 
relationship of its location with that of the diagonal line of the 
supporting legs during the particularly-important two-legged supporting 
phase. When such a foot sole area is taken into account, ZMP is found to 
be within the supporting leg area, eliminating the necessity of dynamic 
control. Upon completion of the two-leg supporting phase, therefore, free 
legs move to a prescribed touch down point and it returns to the instructed 
static walk pattern to continue static walk. 
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Figure 8. Relationship of ZMP With Two-Leg Supporting 
Plane (Foot sole area taken into account) 


During the two-leg supporting phase, the body's center of gravity can, of 
course, be kept on the median of the diagonal line of the constantly 
supportive legs, provided the body's gravity center and motion trajectory 
are adjusted precisely. Such dynamic stability control ensures the 
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prescribed walk to occur. with motion performed substantially as planned. 
Such adjustment is believed to be necessary for the f = 0.5 trot gait or 
similarly smooth dynamic walk. This will be studied in detail in the 
future. 


6. Walking Experiment and Discussion 


In order to verify that which has been described above, the authors 
experimentally manufactured the four-legged walking model TITAN-V, shown in 
Figure 11, and conducted experiments. This model had a full 8 degrees of 
freedom and its legs were driven x- and z-axially. It weighed 13.5 kg. 
Each of the legs weighed 0.96 kg and measured 1,000 am in overall length. 
The x- and z-axes were driven with a 30 W DC motor as the actuator via a 
1/43 or 1/159 reducer, respectively. It had leg soles. It was driven by 
a partially-elastic wire pulley system to maintain a horizontal posture, 
parallel with the body. 
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Figure 9. Results of Leg Trajectory Follow-Up Experiment 


The first experiment was conducted on the leg trajectory follow-up by the 
TITAN-V. Its results are shown in Figure 9, with the solid or broken lien 
indicating the target or actual trajectory, respectively. A leg in the 
trajectory that required consideration of the acceleration and deceleration 
or did not require it showed low or quite high follow-up performance, 
respectively. 


In the experiment, a feed-forward-type z-axial control, called the 
supporting power calculation method, was supplementally introduced to 
improve the walking legs’ follow-up performance. When the x-axial drive was 
examined, it was intended to calculate the static supporting power of the 
legs on a real-time basis to obtain the approximate value of the torque 
generated by the actuator beforehand. 


Figure 11 shows the static/dynamic transition walk behavior. The lamps 
attached to the body and a front leg draw the motion path. It was learned 
from the experiment that the smoothness of the static/dynamic transition 
gait was sufficient. Figure 12 shows the swing detected by a gyrosensor 
fitted on the body. Although the swing increased slightly, the transition 
to dynamic walk was possible without dynamic control, indice<ing that the 
walk continued. The walk constants obtained at this time were as follows: 
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Figure 10. Leg Motion Path Obtained by Introducing Supporting Calculation 
Method 


(Leg trajectory is corrected by the value corresponding to the 
supporting load forecast in supporting leg phase (ff = 0.7).) 





Figure 11. Static/Dynamic Walk Experiment 


(Walk transition § = 0.7 to 0.8; lamps attached to the tip of 
the leg and the body draw the transition path.) 





Figure 12. Swing of Body on Static/Dynamic Transition Walk (the gyro fitted 
on the body is used for measuring) 
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duty ratio 6, = 0.8, 6, = 0.7, leg stroke A” = 250 mm, leg ascending 
amplitude h, = 50 mm, resetting speed V. = 300 mm/second, x-direction 
acceleration a = 2,200 mm/sec* leg speed Vz, = 75.0 mm/sec, Vg, = 128.6 
Vea = 554. . 


It has been pointed out here and verified through experiments that the 
dynamic posture in the dynamic walk of stati«:/dynamic transition gaits is 
not as difficult to control as had previously been thought, i.e., this 
control is facilitated by applying the static walk control method. In 
addition, research has been conducted involving the acceleration-reflected 
leg trajectory generation method, static/dynamic transition walk method, 
etc. The authors would like to develop an increasingly dynamic walking 
machine by introducing the trial-and-error dynamic walk parameter adjustment 


method’ already proposed. 
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Tokyo 4TH INTELLIGENT ROBOTS SYMPOSIUM PAPERS in Japanese 
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[Article by H. Kisura, I. Shimoyama, and H. Miura, Tokyo University) 
[Text) 1. Introduction 


(1) The study of the static stability retaining alk (static walk) 
performed with the center of gravity always positioned within « polygon 
formed by the touch down legs. 


(2) The study of statically-unstable, dynamic stability retaining walk. 


for the design of walking robots planning their walk. The 
experiment referred to as “Collie-2," employing a four-legged robot (Figure 
1), ‘illustrates the propriety end usefulness of that which has been 
discussed above. 














Figure 1. Mechanisa of Collie 2 
2. Study Object Gait 
2.1 Basic Symmetrical Gait 


Animals’ two-legged paired gaits are included among the basic four-legged 
dynamic gaits. They are referred to as: 

Trotting: diagonal legs move at the same tine. 

Pacing: right or left legs move at the same tine. 

Bounding: front or rear legs move at the same tine. 


This paper will not deal with bounding. 


to facilitate analysis. 

3. Stability of Valk 

5.1 Dymemic System of Inverted Pendulus 

A two-legged support eystem as the basic symmetrical gait is simplified into 
inverted pendulum systems, as shown in Figures 2(b) and 3(b), if « 
supporting leg ankle actuator does not exist. Since both supporting legs 
perform substantially the same motion, the gotion of the plane (shadowed 
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parts in Figures 2(a) and 3(a)) thus formed is represented by the plane 
motion of one link, and is reflected in the body of a robot by neglecting 
the motion of the free legs. Discussed in this chapter will be the 
relationship between the stability and period of walk in such a simplified 


Figure 2. Trot Gait and Inverted Figure 3. Pace Gait end Inverted 
Pendulum Model Pendulum Model 








Inverted pendulums, such as those shown in Figures 2(b) and 3(b), are 
statically unstable. Therefore, it is difficult to control them so that the 
object does not fall. While walking, therefore, free legs are caused to 
touch down within a certain time to prevent the supporting legs from 
falling. Here research will be conducted only on normal walk. When the 
walking period becomes long for inverted pendulum systems, such as those 
shown in Figures 2(b) and 3(b), the amplitude of the supporting leg motion 
becomes large, making it possible for a fall to occur. Therefore, each 
basic symmetrical gait is assigned the maximum period T,,, that will ensure 
stable normal walk. 


3.2 Maximum Walk Period of Trot 


The maximum value T,,, of such a period that the amplitude of motion of an 
inverted pendulum, such as that shown in Figures 2(b), is within its 
allowable range can be calculated experimentally. When stride S becomes 
large at this time, the initial value of its fall angle becomes large 
(Figure 4), decreasing T,,,. 


According to the results of the experiment in which roll motion is not 
controlled by mechanically restraining the waist roll joints in Collie-2, 


Tex ™ about 0.8 (sec) when S = 0 cm 
Teax * About 0.6 (sec) when S = 6 cn. 


3.3 Maximum Walk Period of Pace 
A roll motion system, such as that shown in Figure 3(b), ensures stable two- 


legged support by a reciprocating motion. Its T,,, value can be expressed 
as follows through simple dynamic analysis: 

















Stride to terse 
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the Center of Gravity the leverted Peadsics 


Figure 4. Relationship of Stride With Initial Value of 
Inverted Pendulum (Trot Gait) 
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where: 
¢ : length of supporting legs. 


Tex ~ 9.99 (sec) can be obtained when the physical amount « = 0.3 (m) of 
Collie-2 is substituted in the above equation. T,,, = about 0.85 (sec) was 
obtained in the experiment. 


4. Maximum Movement Speed 


When a = 0.5, movement speed V, can be expressed as follows: 


ve = 38 (3) 


As is indicated by this equation, an increase in movement speed V, is 
possible by increasing stride S or decreasing walk period T. Currently, 
maximum movement speed V,.,, depends on the output limit U,,.,, of the free leg 


driving actuator. The relationships of V,.., with S and T will be formulated 
below. 


To swing a free leg forward over stride distance S$, it is necessary to 
accelerate or decelerate it. The maximum value U,,, of the inertia force 
compensating torque required at this time is proportional to stride S$ and 
counterproportional to the square of the walk period, as indicated by: 


Umes = 48) % (4) 
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stride 
walk period 


length of free leg 
inertia moment of free leg 


ae aw 


U., must be smaller than U,,,,,. When equation (4) is substituted for 
Uses < Viseie, therefore, 


$< “eet x er (9) 


is obtained. This indicates that the upper limit value of the stride is a 
function of walk period T. Maximum stride S,., depends on the maximum period 
Tees for stable walk, as described in Chapter 3 and as indicated by: 


Smee = Het x Tag (6) 


When equation (5) is substituted for equation (3), 


Vo s Bet xix (7) 


is obtained. This equation indicates the following: in order to increase 
the movement speed, reducing the walk period is not expedient in achieving 
the maximum movement speed but, instead, it is desirable to maximize the 
period and stride. Stride S$, however, cannot exceed twice the leg length. 
Therefore, restriction 


$< 2 (8) 
is given. 


When walk period T does not exceed the maximum period T,,,, either of the 
following is given depending on whether U,,,,, and J or + are large or small. 


(1) Type-a: S,.. < 2+ since the actuator output limit U,,.,, is small. 
In this case, the maximum movement speed V,.., depends on walk period T,,, 


(Figure 5 point-A), since the restriction condition of equation (8) can be 
disregarded. This can be derived from equation (7) as follows: 


Vomes = BSH x 1X Tras (9) 














—- a. = >= 


(2) Type-b: S,,. > 2s, since actuator output limit U,,.,, is large. 
In this case, a walk period 


· (10) 


that maximizes movement speed is given (Figure 5 point-B), since the stride 
is limited by equation (8), and maximum speed V,,., can be derived as follows 
from equations (3), (8), and (10): 


Von = | ste (11) 


Collie-2 can be said to be of Type-a since U,,.,, = 1.15 (mm), J = 0.0153 
(kgm*) and « ~ 0.3 (m) and, when T = 0.8 (sec), S,., = 0.3 m. Dogs and other 
animals have been classified as Type-b since their stride has been observed 
to be constant, regardless of movement speed. 


5. Movement Energy 
5.1 Definition 
In the case of walking robots, such as Collie-2, that obtain a large torque 


from large amounts of current using an electric motor, the most energy 
consumed during walking in Joule’s heat loss represented by 


n= [Sager 4) 


where, R, = motor resistance, G, = reduction ratio of gear, and K, = torque 
constant. 


Torque (u,) can be obtained by solving the kinetic equation for walk 


trajectory. Here, the energy required per unit movement distance (movement 
energy) is represented by 


P= aR (13) 


The many parameters used to plan the walk process can be obtained from 
employing the condition that movement energy P is minimized. Calculating 
the walk period so that the energy of movement at a certain speed will be 
minimized will be discussed here. 


5.2 Calculation of Walk Period 
Pe Cre + Copy tig + Sn T Vo + Slt (14) 
is obtained (Appendix-1) when the movement energy P of a certain gait is 


expressed directly in terms of walk period T and movement speed V,, where the 
terms have the following significance: 
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First term: energy to swing free legs fcrward 

Second term: energy to swing legs up 

Third term: gravity-compensating energy dependent on the fall angle 
of the supporting legs 

Fourth term: gravity-compensating energy to support the body, 
including the free legs, of a robot 


The values of the coefficients C,,, etc., of the terms of equation (14) for 
each gait can be obtained by dividing the P-value, calculated with equations 
(12) and (13), into elements (Appendix-1). 


When dP/dT = 0 is solved using equation (14), T, in which P is minimized in 
relation to movement speed V,, can be obtained. Intuitively speaking, this 
is because an increase or decrease of walk period T causes an increase in 
stride S or free leg alternating current, resulting in an increase of the 
third term, or of the first and second term, respectively, of equation (14). 
Figure 6 shows the results of calculating basic symmetrical gaits. 
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5.3 Result of Movement Energy Calculation 


Figure 7 shows the results of calculating the movement energy P for the 
trotting, pacing, and static walk (a = 0.75, crawl gait with leg movement 
delayed by 1/4 period) of Collie-2 using equations (12) and (13). The 
movement speed V, at the rightmost point of each gait or walk period 
indicates the maximum movement speed V,,,, as described in Chapter 4. 


6. Experiment and Discussion 

6.1 Experimental Results 

Figure 8 shows photos of trotting and pacing. Figure 9 presents the results 
of trotting, pacing, and static walk experiments. The leftmost point of 
each gait or walk period indicates its maximum movement speed. 
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Figure 9- Relationship Between Locomotion Speed 
and Energy (Experimental results) 


ct speed Suu 
occurs with the elongation of that trot and pace period. This is clearly 


© Gait and govenent energy 


similar to that of the calculated results shown in Figure 7- For a low- 


During static valk, maxisue poverent speed Vous is very low since a cannot 
be smaller than 0.75. Suring trotting, oo the other hand, the elongation 


r povemen 
dec , described in Chapter °- Therefore, it is preferable that 
Collie-2 perfors small movement energy trotting et safe 


7. Conclusion 


In studying “stability.” *povement speed,” and “movement energy” ** indices 
of four - Legge4 walk, the authors concluded the following: 

















(1) The walk period considerably influences the indices. In order to 
increase the maximum movement speed, it is desirable to employ a long period 
and a large stride. They are limited, however, by the stable walk maxinus 
period. A maximum movement speed walk period is given, as is a sininus 
movement energy walk period for a certain speed. 


(2) Representative gaits are divided into trotting, pacing, and bounding. 
They exert substantial influence on the indices. Trotting is preferable at 


safe movement speeds, while pacing is preferred at other speeds. 
Appendix 1: Induction of Equation (14) 


The terms mentioned in 5.2 can be formulated based on the following 
assumption: 


(1) Pree-leg swinging-forward energy 


When it is assumed, as described in Chapter 4, that the inertia-force 
compensating torque is proportional to stride and counterproportional to the 
square of the walk period, 


s a 
E,wing * Const. x T=zCr. 
— (1.1) 


(2) Free-leg swinging-up energy 


When it is assumed, similar to (1) that the inertia-force compensating 
torque for a certain swinging-up altitude is counterproportional to the 
square of the walk period, 


Bug = Comat. x (sig)? xT = Copa (1.2) 


(3) Gravity compensating energy depending on fall angle of supporting legs 


The body and supporting legs of walking machines basically require no 
acceleration/deceleration during normal walk, so the gravity compensating 
energy becomes dominant. If the gravity compensating torque applied to the 
supporting legs is assumed to be proportional to the stride when their fall 
angle is not very large, then 


Exupport = Const. x S* x T = C,.Tv,? (1.3) 


(4) Gravity compensating torque for supporting walking machine's body, 
including free legs 


If the gravity compensating torque of the body, including the free legs, is 
assumed to be nearly constant during the two-legged support pace period, 
then 


Exoay ~ Const. x T = ChodyT (1.4) 
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The following equation is obtained from the above equation and (13). 
E, = Eyeing + Exp + Esupport + Enoay: 


Va i 
P= Coe G+ Cap Gig + CT Ve + Sot (1.5) 


It has been confirmed through calculations that the assumptions described 
above are pertinent, and the coefficient C,,, etc., of equation (14) are 
nearly constant, regardless of movement speed VG and walk period T, in each 


of the basic symmetrical gaits, and that the following values have been 
obtained for Collie-2: 





Cc Cc AH(m) (Js?) 
Gate) esa) (aad * 


Trotting 80 
Pacing 80 























Development of Adaptive-Locomotion-Type Four-Legged Robot 
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{Article by H. Adachi and N. Kotaniuchi, Mechanical Engineering Research 
Institute; and E. Nakano, Tohoku University) 


{Text} 1. Introduction 


Recently concern has been growing in regard to the movement function of 
robots. Research is in full swing of conventional wheel-type robots as well 
as of legged ones that would exhibits excellent ground adaptability. The 
latrer are divided into two-legged, four-legged, six-legged, and other 
types. Despite their potential, the problem with legged locomotion robots 
invelves their complicated mechanism and control. The authors are now 
engaged in developing a six-legged fixed gait walking robot in order to 
solve this problem. Since a link mechanism is used to ensure the freedom 
of gate generation, basic control of leg motion is facilitated and 
importance is attached to environmental adaptation. Free gait systems, 
however, are advantageous for flexible walk. This paper will deal with a 
free gait type four-legged walking robot which the authors have developed. 


2. Leg Mechanisa 


A number of walking robots have already been developed, with varying leg 
mechanisms. The supposition is that, since walking was originally a form 
of animal locomotion, the robot’s leg mechanism should imitate that of 
animals. However, the authors do not believe that this imitation is always 
necessary since they do not involve the use of the same materials and 
actuators as living bodies. The robot developed here, therefore, employs 
a new “astballem" mechanisa, as shown in Figure 1, for their legs. This 
three joint like-type mechanism has two degrees of freedom,each of which is 
connected to the link OA revolution @ around point O of the variation in 
length of link OA. Im Figure 1, the symbols "1," “s," and “B" denote the 
basic length, variable and the slide mechanism moving in a negative 
direction y-axially, respectively. Its most outstanding feature is that the 
C-point false linear motion can be ensured by applying either of the degrees 
of freedom. Figure 2 shows the path of its point-C that is obtained when 
(s) or @ is changed from 1.0 to 2.4 or from -180° to 180° on the assumption 
that a = 300 (mm), 1 = 25 (mm), and k = 0.25. Figure 3 shows the 
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inclination of the path in Figure 2. As can be in 

path is horizontal and nearly linear when (s) and @ are within the range of 
1.0 to 1.2 and t50°, respectively. When the walking robot supporting leg 
motion is linear, the vertical motion of the robot is controllable. This 
can be ensured by applying either of the degrees of freedom. The self- 
support force separating-type leg driving mechanism is thus obtained, 
enabling it to walk with high energy efficiency. The above description 
suggests that the linear part is utilized for support period leg motion, and 
that @ can be driven with an increased s-value during the resetting period. 
Figure 4 shows the influence exerted by the weight of the robot on its leg 
drive. During the support period, the robot’s legs are subject to the 
reactionary force of the ground surface since it supports the body load. 
Part of it rotates link OA. If it is small, link rotation (#@) is not 
influenced by the weight. It can be seen in the graph that the influence 
of the reactionary force of the weight is small when it is used for motion 
during the support period (the absolute value of @ is comparatively small 
and the (s)-value is 1 to 1.2). 
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Figure 1. Principle of Astballen 








Figure 2. Trajectory of Point C 
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Figure 3. Gradient of Trajectory Figure 4. Reaction Force Effect 
Some part of the reaction 
force of the robot weight 
becomes the force that 
rotates bar OA. The axis 
of ordinates indicates 
(rotating force) /(reaction 
force). 


The coordinate conversion equation and reverse conversion equation for the 
link mechanism are given below. If the coordinate of point-C in Figure 1 
is denoted by (x,y), and 
x = sl siné (1) 
y = sl cos# - 1(1/k-1) (k*a*-1*s*sin*s)* (2) 


Their reverse conversion equations are: 


s = (1/1) (p* + q*)* (3) 

@ = tan’ (p/q) (4) 
where: p= kx (5) 

q = y + (1-k) (a*-x*)* (6) 
3. Hardware 


The authors experimentally manufactured a four-legged walking robot 

TURTLE-1, with an astballem mechanism, as is shown in Figure 2. It measures 
500 am in length, 330 am in width, and 380 mm in height, and weighs 17 kg. 
The size of the link mechanisa is: a= 300 mm, 1 = 25 mm, k = 0.25. 

Figure 6 is a photograph of the link drive part. Each of its 2 degrees of 
freedom (# and s) is driven by a DC servomotor. A ball screw is driven by 
@ worm-worm wheel to vary value (s). Each driving part of (s) is rotated 
by a flat gear connected to a reducer to vary value @. Values (s) and @ are 
adjustable within the ranges 1~2.5 and 290°. A leg extension mechanisa is 
provided at the tip of the legs. A decrease in their length is possible 
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through the on-off control. However, this sechanism was not set on walk due 
to shortage of leg extension force. 





Figure 5. Photograph of TURTLE-1 Figure 6. Photograph of Leg Driving 
Mechanism 


The robot employs a potentiometer to detect angle (#) and length (s) of the 
link of each leg. Each of its motors has a tachogenerator. Its foot parts 
are fitted with a microswitch to detect contact with the ground surface and 
a force sensor to measure the leg load. Figure 7 is a photograph of the 
sensors. The force sensor utilizes the hole effect. In addition, it is 
fitted with a pendulum-type inclination angle sensor to measure its body 
posture. 





Figure 7. Sensors Attached in Foot 
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Figure 8. Control System of TURTLE-1 


50 











553531537 
pulls 


Le : Tee 
ee di 








and tween 3 and 4 is 0.5. 
tween or 2 and 3). 


4 is the phase difference be 


The phase difference between 1 


Feet Position-Time Trajectory 


Figure 9. 





(7) 


It has been 
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l-pcesp-0.5 


of gravity is located outside of the support polygen. Even if equation (7) 


learned while studying the gait obtained by varying the phase difference ¢ 
In other cases, static stability cannot be retained when the robot's center 


First, static walk requires the #-value to be larger than 0.75. 
that static walk is possible when: 








is satisfied, the stability allowance depends on the ¢-value. It can be 
represented as follows 


Sy = 8 (28 + 26 - 2)/(28) (8) 


where (s) is the stroke. It is learned from equation (7) that the maximum 
allowance s(48 - 3)/(28) can be obtained when ¢ = # - 0.5. 


Semidynamic walk is such that the static support of the robot body by three 
legs during a portion of the walk period and by fewer than two legs during 
the remaining portion occur alternately. In this case, duty factor # can 
take a smaller value than 0.75. However, its lower limit is 0.5. High- 
speed static walk is limited since the speed of the resetting legs must be 
more than three times that of the supporting legs. Semidynamic walk with 
B less than 0.75 is possible at a high speed since the speed difference 
between the returning and supporting legs can be reduced. It has been 
learned in studying the gait obtained by varying ¢, as described in 
connection with static walk, that a gait suitable for semidynamic walk is 
obtained when 


0<¢<f-0.5 (9) 


In other cases of even three-legged ground contact, the center of gravity 
is located outside of the support polygon or support is performed by same- 
sided legs during a certain period. Same-side two leg support is not 
desirable since the experimentally-manufactured robot has no horizontal 
degree of freedom in the frontal lane. Duriig two-legged support, the 
distance between the straight support line and the center of gravity of the 
robot is a minimum when ¢ = f - 0.5. The gait obtained at this time is 
believed to be the most suitable for stable walk. Figure 10 is a leg-timing 
chart obtained at this time. 





Figure 10. Feet Position-Time 
(p= 0.7, ¢ 
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During two-legged support, it is necessary to examine the dynamics of the 
robot since the position and posture of its body cannot be changed by the 
movement of the supporting legs. The motion of a robot, seen as an inverted 
pendulum, was calculated on the assumption that as it moves, it maintains 
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a certain altitude. For continued walk during two-legged support, it is 
necessary to set the following initial speed: 


Vv, > (8; + 83) p/2 (10) 
p = (g/h)* (11) 


where v, is the gravity center movement speed obtained when two-legged 
support starts, s, and s, are the positions of the front and rear supporting 
legs, respectively, (g) is the gravity center acceleration, and (h) is the 
altitude of the gravity center of the robot. During two-legged support, a 
robot moves as follows in the direction of its advance. 


x = ((2v, - p (8; + 8,)) e* 
- (2v, + p (8; + 82)) e™*)/(4p) (12) 


5. Walking Experiment 


Figures 11-13 show the leg-tip force sensor output obtained during the 
walking experiment. The vertical axis indicates the load of the legs and 
the high-level part of the graph a loaded leg, i.e., a leg in contact with 
the ground. The scale on the vertical axis of the graph has no absolute 
significance because it is shifted to facilitate its read. 
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Figure 11 demonstrates static walk with 6 = 0.8. It indicates that its 
support pattern has definitely changed. It exhibits the repeated cycles of 
six support patterns: 1) support by four legs; 2) support by three legs 
excluding the left rear one; 3) support by three legs excluding the left 
front leg; 4) support by four legs; 5) support by three legs excluding the 
right rear one; and 6) support by three legs excluding the right front leg. 
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Figure 13. Output of Foot Force Sensor 
(6 = 0.7) 


Figure 12 shows the static walk with 8 = 0.75. It also indicates that its 
support pattern has changed. It exhibits four support patterns: 1) support 
by three legs excluding the left rear one; 2) support by three legs 
excluding the left front one; 3) support by three legs excluding the right 
rear one; and 4) support by three legs excluding the right front one. 


Figure 13 illustrates the semidyuamic walk with 6 - 0.7. It differs from 
the above two in that no distinct change of support pattern can be read. 
Ideally, the following support patterns are repeated: 1) support by three 
legs excluding the left front one; 2) support by the right front and left 
rear legs; 3) support by three legs excluding the right rear one; 

4) support by three legs excluding the right front one; 5) support by the 
left front and right left legs; and 6) support by three legs excluding the 
right rear one. This is believed to be attributable to the following: the 
robot is not absolutely the same as the model (inverted pendulum), the 
motion of the returning legs causes force to be exerted on the robot's body 
so that it loses its balance, and a leg that should originally have risen 
above the ground surface moves along it due to its slow vertical motion. 
As is seen in Figure 13, two-legged support occurs distinctly and 
semidynamic walk is performed. 


6. Postscript 


The authors experimentally manufactured a free-gait-type four-legged walking 
robot and studied the gaits for possible application. They proposed a walk 
form termed semidynamic walk, and evaluated it, as well as static walk, in 
respect to leg load. The robot had many restrictions due to its low degree 
of freedom. They would like to continue studying walk in the future using 
a high freedom level. 
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[Article by A. Nishi, Miyazaki University) 
[Text] 1. Introduction 


The author designed a robot capable of performing safe locomotion on a rough 
wall surface at a high speed. Provided with a thrust motor, combining an 
engine and a propeller, and with a small jet engine, it utilizes the 
frictional force obtained when its vehicle with wheels or crawlers is 
pressed against the wall surface, with the thrust power working line 
inclined toward the wall surface. He has also studied the thrust motor's 
characteristics and design conditions that are required when a robot with 
such a mechanism moves along the rough surface of a vertical wall, such as 
the outer wall of a multistored building. First, this paper will describe 
the safety conditions required for oblique locomotion along the wall surface 
and the advantages of a wheel drive. Next, in order for the robot to move 
safely along the wall surface of a multistoried building, it is necessary 
to give due consideration to the influence of the wind. The wind resistance 
of the vehicle influences its shape. Therefore, the former can be 
calculated experimentally when the latter is determined. On the other hand, 
the inclination of the thrust motor is changed when the robot is controlled. 
Therefore, it is necessary to experimentally examine the wind influence on 
the thrust motor. In general, the wind velocity changes randomly, so the 
thrust motor’s resistance to its power spectrum is being examined. The 
characteristics of the thrust motor depend on the inertia moment of the 
rotary part and the air flow within. Large and small ones, therefore, have 
different characteristics. Here the resistance variation obtained to the 
velocity of the air in a wind tunnel will be measured using a small thrust 
motor model, the results of which will be used to examine its 
characteristics, and control will be studied in order to secure the safety 
of the robot on the wall surface. 


55 











2. Conditions for the Safety of Robot on Wall Surface 
2.1 Oblique Movement 


Since insufficient thrust power is generated, the minute control of a 
vehicle is necessary to prevent it from falling during oblique locomotion. 
First, it is necessary to decrease the probability of engine failure by 
providing two thrust motors. The mutually opposite torques applied can be 
canceled by rotating the engines opposite each other. The model in Figure 
1 was assumed to be such a two-engine type. It was designed to be capable 
of obliquely moving along the rough wall surface of a building when its 
wheels were brought into contact with the tip of a rise and when all of then 
were inclined at the same angle. 


RE 


Figure 1. Relationship of Wheel Inclination and 
Thrust Power of the Model 





If the inclination angle of the wheels, that of the combination thrust power 
and that with the wall surface of the combination thrust power obtained when 
the wheels are not driven are denoted by @, a, and 7, respectively, the 
formula for the balance between the force in the same direction as the 
inclination of the wheels and that orthogonal with it are given as follows: 


Teos 7 cos (@ - a) > W cos @ (1) 
Wsin @ - Tcos 7 sin (@ - a) < w Tsin 7 (2) 


where w is the coefficient of the friction of the wheels with the wall 
surface in the same direction as the axles of the vehicle. Both formulae 
can be converted as follows: 


di» 6 ets 

Ww «YE cos (0-8) (3) 
ae § =f... 

w MSin@® + cost ¢in(O-G) 





(4) 
T can be minimized when @ = a. 
y= tan’ (tan @/p) (5) 
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Formulae (3) and (5) are shown in Figure 2. 


a & & aa 











Figure 2. Relationship Established Among 7, ¢, and 
T/D When Wheels Are Not Driven 


2.2 Wheel Drive 
The driver's weight was increased since it drives the wheels. This is 
in some cases because it is capable of converting the force 


component of the wall surface pressing direction into thrust power. 
Combination thrust power is given by equation: 


T,/T = cos 7 + w sin 7 (6) 
The maximum value of T, is given as follows: 
7 = tan™ » (7) 


7 < 45° when pw is generally smaller than 1. The relationship between » and 
7 in equation (7) and T,/T in equation (6) are shown in Figure 3. When yw is 
large, T,/T is large. 
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Table 3. Wheel Driving Combination Thrust Power 
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Next, Figure 4 shows the relationship established among /, 7, and » when the 
vehicle locomotes obliquely to the direction the wheels are driven. The 
relationship 


@ = tan" 


can be obtained from equations (5) and (7). The equation sg = 0.7 will be 
examined in connection with Figure 4. When # = 26.1°, the curves 
represented by equations (5) and (7) intersect. When @ is smaller, the 
wheel drive thrust power can be increased by utilizing the #@ - 
relationship of equation (7). When @ > 26.1°, 7 in relation to #@ 
equation (5) may be used. In this case, however, no advantages can 
obtained from wheel drive. 
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Figure 4. Conditions for Wheel-Drive Oblique Locomotion 
3. Wind Resistance of Thrust Motor 
3.1 Normal Vind 


To move safely along the vertical wall surface of a multistoried building, 
it is necessary to take the wind influence into account. A few detailed 
data involving the wind’'s influence on the wall surface exist. This will 
be studied in the future. Specifically, gust-related safety measures for 
robots of this kind are very important. 


In this connection, first the thrust motor’s resistance to normal wind 
(fixed velocity) was examined through experiments. A thrust motor model, 
whose 0.4 m propeller was driven by a 600 W input motor, was installed in 
alm x 1 @ section wind tunnel, and the velocity of the wind and the 
running speed of the propeller were changed from 2 to 8 m/s and 2,000 to 
6,000 rpm, respectively. As shown in Figure 5, the windward or leeward 
inclination angle of the propeller was fixed at 40°. Its thrust power, 
torque, and resistance in various cases were measured and expressed, as 
follows, in terms of the coefficients of x, y, and running direction. 
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7° > (8) 








the resistance (N) in the same direction as the wind, Q is torque (N+), 
V is wind velocity (m/s), § is the area (m*) of the propeller, R is the 
radius (m) of the Propeller, » is the density of the air (kg/m*), and is 
the 5. 


Cy 


It is learned from Figure 5 that a slight deflection of the air current in 
the wind tunne)] results in slight Tesistance of the Propeller when it is 
inclined windward (8 > 0). When the inclination is leeward, the air 
Currents behind the p and in the wind Cunnel run counter to each other 

0). 


Figures 6(a), (b), and (c) show C,, C,, and C,, Tespectively. on windward 
inclination, C, is expressed in terms of negative values since the horizontal 
axis component of the thrust Power of the Propeller is larger than the 
resistance, so the combined force is directed windward. When £ < 0, C, is 
expressed in terns of positive Values since both the thrust power and 
resistance are directed leeward. Horizontal] axis \ « u/v, where (u) is the 
circumferentia) Speed of the Propeller, and its Practical values are 

200 .« 300 m/s. A = about 10 . 30 if the velocity (v) of the wind at the 
wall surface of « building is assumed to be 10 30 m/s. C. values are 
“rranged in the order of the inclination angle of the Propeller indicate 
that the resistance depends on the inclination angle. 


C, Corresponds to \ « about 10, « very small value when compared to 
B = +20 Ag or +30°. 


The torque coefficient Cq does not vary much with 2. 
3.2 Relationship Between Thrust Power and Resistance 
Figure 7 shows the relationship between thrust power T and resistance Dp, 


confirming the wind velocity Fange at which a robot of this type is safe on 
the wall surface of a building and the Propeller inclination range. 
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Figure 6(b). Force Component 
Orthogonal to Wind 








Figure 6(a). 





Force Component in a —R 3 


Same Direction as Wind 


Figure 7. 








Figure 6(c). Torque Component 

















Thrust Power to Resistance Ratio 
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T/ =-4- 20, 4 - 15 or & - 8 when A = 10 - WO and £ = +30°, +10° or -30", 
respectively. The thrust power exhibits «a 
of resistance in all cases, and the possibility exists of securing safety 


by properly adjusting the thrust power angle. 
3.3 Side Wind Safety Conditions 


As is clear from the experimental results described above, different 
resistances work depending on the fitting angle of the thrust motor when a 
side x ~ is present. 


When the thrust motor and vehicle have side wind resistance D, it is assumed 
that the latter’s safety is secured by increasing thrust power T and wall 
surface side inclination angle 7, as shown in Figure 8, based on the 
variation of T/D described above. Side wind resistance D is decomposed into 
the component in the thrust direction (same as the inclination angle of 
wheels) and that orthogonal with it, and the newly-required thrust power and 
side wall inclination angle are denoted by T’ and 7’, respectively, giving 
the following force balance conditions: 


T’cos 7’ > ¥Ycos @ = Dsin @ (9) 
p T’sin 7’ > Wsin @ + Deos @ (10) 
From this we obtain: 
va tan’ { L Ow ~ tone 
*~ 1+ (O/w)te6 
, (11) 
Ty #80 2(0/w)sing 
w Cos 5’ 











(12) 
r — 
F 
4) 
-_ 0 
| 
Figure 8. Relationship Between Forces Obtained With Side Wind 
The following can be derived from formula (3): 
wt * 

cot (3)' 
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when # = a (in this case, it is assumed that a ⸗ §). Therefore, in formulae 
(11) and (12), 


22 
w Tus? £13) 


Control rates 47 and AT/W are obtained fron: 


, 7, t 
a8 8 2 te eae 


= tan” ( tanO/a) (14) 
To . eps Oeeen) we 
* 5.* wr’ oy (15) 


As shown in Figure 7, T/D values are experimentally given for A. Therefore, 
A is specified for « certain wind velocity when the circumferential speed 
of the propeller is known, and T/D can be calculated when the inclination 
angle # of each thrust motor is given. Therefore, the increment of the 
required thrust power and the increment 47 of the inclination angle 7 of the 
thrust in the same direction as the wall surface can be obtained from 
formulae (14) and (15). 


3.4 Thrust Motor Resistance to Abnormal Vind 


The resistance of the thrust motor to an abnormal wind whose velocity varies 
hourly has been obtained through experiments. The blower in the wind tunnel 
is controlled by an invertor. Controlling the wind velocity to within a 
certain range is possible through the use of a computer. 


This time the variation of the resistance, torque, and thrust power of a 
thrust motor in a nearly sine waveform at range V = 4 - 8 u/s was measured. 
The examples of the results of this measurement, conducted when the 
propeller was fitted at +30°, 0°, and -30°, are shown in Figure 9. The 
absolute values of the resistance obtained in this case do not correspond 
to the results mentioned above since it is orthogonal to the thrust power. 
All curves, however, show little time lag corresponding to wind velocity. 
This example is obtained when the wind velocity variation period is 4 
seconds. Longer periods provide similar results. 


The model used for the test was small and shows a very high frequency 
characteristic since the inertia moment of its rotary part is small. Since 
an actual thrust motor is large, however, it would show a correspondingly- 
long time lag. The following has been learned from the above description 
the air force exerts such « small influence on the propeller the thrust 
power and resistance waveforms are only slightly deformed. However, this 
is not believed to cause any great time lag. 


In this case, the time lag of the wind tunnel’s blower and the limits of the 
invertor performance prevented the test from being continued. However, in 
the future we plan to make the thrust motor capable of higher frequency 
performance, required for higher resistance to actual wind. 

















Figure 9. Abnormal Wind Characteristic of Thrust Motor 


Im light of the test results described above, it can be said that the brief 
time lag of the thrust motor model with respect to wind velocity variation, 
with a period more than 4 seconds, and its dynamic thrust power and 
resistance variation can be explained in terms of its static 
characteristics. 


The wind that is in direct contact with the front side of a building wall 
and the rear current side wind that is in contact with the back of the 
building, on the other hand, are thought to have such different 
characteristics. The latter’s velocity is believed to show a large 
variation, while the former's shows a small variation, even when it is high. 
The low- and high-layer components of wind are believed to exhibit quite 
different characteristics. Their measuresent and examination will be 
necessary in the future. 


4. Wind Safety Measures 


The safety of robots of this kind will be examined based on the abnormal 
test results described above. First, wind velocity is assumed to undergo 
the same v - 4 - 6 a/s sine waveform variation as that in the test. If the 
period of wind velocity variation is fixed at more than 4 seconds, the 
static characteristics in Figure 7 are directly applicable. A = (u/a)cosec 
wt if v = a sin wt is assigned to A = u/v in Figure 7. Figure 10 shows an 
approximation of T/D for 4 = 10 - 30, and required control rates 47 and AT/V 
obtained from formulae (14) and (15) for @ = 20° and wg = 1.0. 


This example illustrates the resistance variation of a single thrust motor. 
If there are multiple thrust motors, it is necessary to take the 
corresponding increase in wind resistance into account. 


An important task for the future will be to estimate the actual variation 
in wind velocity. 
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Figure 10. Variation of Abnormal Vind Control Rate 


5. Conclusion 

The basic design specifications of « robot capable of high-speed locomotion 
along the outer surface of a building have been derived and strong wind 
safety measures examined as follows: 

(1) The locomotion conditions along a vertical wall surface are derived. 
(2) Wheel drive safety conditions are derived. 

(3) Thrust motor resistance to normal wind derived through experiment. 
(4) Thrust motor resistance to velocity-varying abnormal wind derived 
through experiment. As a result it was learned that the model caused no 
more than a 4-second time lag. 


(5) Control rate can be calculated using static characteristic values when 
time lag is small. The examples of this calculation are described above. 


In the future we will define the properties of the wind striking the wall 
of a building. 
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{Article by T. Teujisura and T. Yabuta, NIT Transmission System Research 
Institute: “A Mobile Robot Walking on an Aerial Path") 


[Text] 1. Introduction 


Communications cables are roughly divided into serial and underground ones. 
During the former's stretching or maintenance, workers are required to cliab 
to an altitude of several meters above the ground. The automation of 
construction and saintenance is desired to liberate humans from such 
dangerous work and increase work efficiency. 


Aerial cable stretching and saintenance robots locomote along trajectories 
and work using hands or the like at prescribed posts. The elementary 
techniques required for them include a sanipulator, and seasuring and 
lecomotion techniques. Several systems are used for locomotion. The 
simplest among them are those which perform rotational locomotion along 
trajectories, such as wheels. Telephone cables generally have metallic 
fittings. The locomotion of wheel-type devices becomes unstable due to the 
vibration, etc., generated when rolling over these fittings. Legged-type 
locomotive devices, on the other hand, are capable of stepping over 
obstacles, eliminating their unfavorable influence on the locomotion 
characteristics. 


The locomotion technique is applicable to flat surfaces, stairs (1), wall 
surfaces (2), ducts ‘3,4), etc. A few reports have, however, been published 
on robot locomotion along the trajectory of a one-dimensional line in the 
air, such as serial cables, which is dealt with here. Wheel, leg (5-10), 
cravler, and other locomotive devices have been proposed previously. Many 
reports (6-10) have been published specifically on the two-dimensional 
surface walk of robots with two- and four-legs and other structures. In 
connection with leg-type locomotion, such research has been conducted 
recently on controlling dynamic walk. The authors’ study, on the other 
hand, deals with static locomotion in consideration of the characteristics 
of the work environment. The optimal design of the mechanisms to provide 
the desired operation has been pursued in order to miniaize control cost. 








This paper will describe the methods and mechanisms for stable locomotion 
along a one-dimensional trajectory, with obstacles, in the air. First, a 
method for stable locomotion along a trajectory will be discussed and an 
appropriate mechanism will be proposed. ‘Second, a suspended locomotion 
mechanism with slider crank mechanism lee: will be designed and 
kinematically analyzed. Finally, the locomction performances of the 
locomotive device will be evaluated, and an optimal design method, planned 
to secure its stability during locomotion, will be presented. 


2. Principle of Locomotion 


Communications cable are generally stretched in the air as follows. Steel- 
wire suspension cables are stretched between poles and communications cable 
bodies are suspended on them using metal devices. A communications cable 
maintaining and inspecting system has been designed to move along the 
trajectory of a suspension cable stretched in the air. The metal devices 
are generally installed at equal distances. Here, they serve as obstacles 
to be stepped over by the locomotive device. 


The continuous rolling of blocks, etc., is effective for moving along a 
trajectory without obstacles. Some systems for winding optical fiber cables 
around power cables have mechanisms for the block locomotion on power cables 
(12). Existing communications cables, on the other hand, have such 
locomotion obstacles as suspenders, connecting terminal blocks, etc. 
Therefore, a device must step over them during locomotion. Legged walking 
systems that intermittently repeat connection and disconnection actions are 
preferable over wheel systems that remain in contact with the trajectory 
during locomotion, as described above, for stepping over obstacles while 
maintaining their stability. Stable locomotion is significant for legged 
walk. The device is suspended on a trajectory. Its gravity center, 
therefore, is located below the trajectory, so it readily maintains its 
stationary stability. During locomotion, on the other hand, its stability 
depends on its motion. This will be described in Chapter 4. 


The motion of a walking system consists of standing and free leg phases (5). 
Walking is performed by alternately repeating the phases. At least 2 
degrees of freedom are generally necessary. Degrees of freedom generally 
involving combinations of turning and extension joints. A mechanism of the 
human upper and lower leg type is constructed by arranging turning degrees 
of freedom in series. In this case, an actuator, corresponding to the 
degrees of freedom, is generally provided, so its structure is large and 
very complicated control is necessary. 


A mechanical method, not a control method, is used to ensure two walking 
phases. When a mechanism (13) such as a link, cam, etc., is used, one 
turning input can approximately be converted into two walking phases. Some 
links are applied to walking machines (14-18). 


Proposed here is a system which locomotes along a straight trajectory in the 
air using a link mechanism and only one actuator. It employs a DC motor, 
as shown in Figure 1. Its driving force is transmitted to the front and 
rear legs by the chain and sprocket. Each leg consists of two slider crank 
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mechanisms, OAB,C, and OAB,C,, as shown in Figure 2. Aim links B,C, and B,C, 
are employed for locomotion, and a gripper, fitted at their tips, is 
suspended on a trajectory to support their weight. The angle formed between 
links AB, and OA that constitute slider crank OAB,C, is defined as input 
rotation angle @. The phase difference between the two slider crank is 
assumed to be the x-radian. In an ideally-designed slider crank mechanism, 
the input turning angle (@) of the free leg phase is as follows: 


0<6< #/2, 3/2" < 6 < 2a, 
and that of the standing legs is as follows: 
a/2 <6 < 3/2n. 


The system locomotes as follows. As shown in Figure 3, it uses the x-axis 
of an xy-coordinate system as the trajectory. The initial position of the 
system is obtained when @ is fixed at 0, and link end C,L is positioned at 
its origin at time (t) = 0. At this item, C,, C,, 0, B,, A, B, line up along 
the y-axis in order. First, the gripper C, passes C,, coming into contact 
with the trajectory when arms B,, C, locomote, with C, remaining at the 
origin. Next, gripper C, leaves the origin and passes C,. The cycle of 
operation described above, i.e., the contact and separation of the gripper 
at the tip of the arm on and from the trajectory, are alternately repeated 
during locomotion. During ,,.,,, grippers C, and C, each come into contact 
with the trajectory at only one point per cycle. Locomotion during which 
obstacles can be stepped over is possible, if arm trajectories are planned 
sufficiently. The ideal trajectories of the arms are of the closed curve 
type and involve a linear standing phase. They can be designed based on the 
results of analyzing the motion of the slider crank mechanisms that 
constitute the arms. This method has been designed to present ideal arm 
trajectories without complicated actuator control by using a mechanical 
function, thereby reducing control costs. 











DC Motor Chain 


Figure 1. Suspended Locomotion Figure 2. Slider Crank Mechanism 
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The motion of the suspended locomotive device mentioned in the preceding 
chapter will be described here, with (a), (b), and (c) denoting the lengths 
of links OA, AB,, B,C,, respectively. Link OA, however, is assumed to 
locomote constantly, parallel with the y-axis. The two slider cranks that 
constitute a pair of legs alternately repeat the standing and free leg 
phases. When they are set to have different «-radian phases, one of them 
is always entering the standing leg phase to come into contact with the 
trajectories. 


Discussed here will be the motion of a pair of legs along a straight line 
y = 0 trajectory in a rectangular coordinate system such as that shown in 
Figure 3. It is assumed that the slider cranks have been set in operation 
with the input turning angle fixed at time function @ = @ (t). CG or C, is 
at a fixed point on trajectory y = 0 when -#/2 + 2nm < @ < «/2 + 2nmx or 2/2 
+ 2nn < @ < 3/2 + 2nx, respectively, where (n) is 0, t1, £2, +++, and it 
is referred to in positioning the legs. In this condition, the motion of 
the legs and trajectory of link ends C,, ©, are shown in Figure 3. 


When the input link rotates at constant speed w, the turning angle, angular 
velocity, and angular acceleration at time (t) can be presented by the 
following equations, respectively: 


6 = wt (1) 
dé/dt = w (2) 
d*9/dt? = 0 (3) 


The motion of the system will be expressed in terms of the reference point- 
0 of the legs in Figure 2. Its coordinate at time (t) is represented by 
equations 


x = (-1)" b(1-c/b(a2/b*41 +2(-1)" a/b 
coswt)™*) sinwt 
+ 2mb(1-c/b(a*/b*+1)™*) (4) 


y = b(1-c/b(a*/b*414+2(-1)" a/b coswt)™) 
* (-1)" coswt+a/b) (5) 


where (m) is an integer as given in formula wt/# - 1/2 < m < wt/a + 1/2. 











Figure 4 shows the locomotion route obtained using the above equations in 
which (c) was changed as a parameter, with a — 1.6 and b = 1 assumed. The 
curve above or below the x-axis represents the trajectory of link end C, or 
system body reference point-0, respectively. 


Trajectory ⸗214 b=1 














Body” = 10! 
Figure 4. Trajectory of Suspended Locomotive Device 


The locomotion of the system can be obtained, as follows, when the above 
equation is differentiated by time: 


dx/dt = (-1)" b (coswt-(-1)" c/b (a/b + (-1)" (a*/b*+1) 
coswt +a/b cos*wt) + (a*/b* +1 +2(-1)" a/b wt)~*/*) w (6) 


dy/dt = (-1)" b(c/b (a*/b*4+14+2(-1)" a/b coswt)~*/? 
* (1 +(-1)" a/> coswt)-1) sinwt w (7) 


Figures 5 and 6 show the locomotion velocity obtained using the above 
equations. The former indicates the x-velocity obtained using c/b as a 
parameter when the link ratio a/b = 1.6 (constant). The values obtained by 
normalizing time by the turning angle velocity w of the input link and those 
obtained by normalizing locomotion velocity by the product of link size (b) 
and angular velocity w are taken for the horizontal and vertical axes, 
respectively. Figure 6 indicates the y-velocity obtained when a/b =< 1.6. 
It has value-0 when the time is 0 or sw, or the maximum or minimum value 
when the item is 1/2aw or 3/2aw, respectively. 


The locomotive acceleration of a locomotive device is given, as follows, by 
differentiating the above equations by time: 


Pu/dt*=(-1)* b (c/ (/E We*A*OR)* a coowt)* +8/ie"A*-1)* } 

+ WA*IED* af coewt)“**=1) sinwt wo (8) 
y/Ah*=(-1)* b (eA We*A*ORE1)* a conwt)** - (1 6-1) * aA coowt)-1) coowt 

+1)" af «cfd We A192-1)* wf coswt) 


+ Q-s*A* o6-1)* af coowt) sin’ wt ) w* ; 
(9) 


69 

















(dx/dt)/d/@ 





(@"x/dt")/o/e" 




















Figure 5. X-Velocity of Suspended Figure 6. Y-Velocity of Suspended 
Locomotive Device Locomotive Device 


Figures 7 and 8 show the locomotive acceleration obtained using the above 
equations. The former indicates the x-acceleration obtained when a/b = 1.6. 
The x-velocity takes value-O when the time is 0 or sw, or the maximum or 
minimum value when the time is 1/2aw or 3/2aw, respectively. The latter, 
on the other hand, expresses y-acceleration. Its total absolute value 
becomes a minimum when c/b = 6.6. 
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Figure 7. X-Acceleration of Figure 8. Y-Acceleration of 
Suspended Locomotive Suspended Locomotive 
Device Device 


The locomotive characteristics of the locomotive body derived from the 
motion of the slider crank mechanism constituting the legs will be evaluated 
to examine its locomotive stability. This depends on the behavior of the 
arm tip during the standing leg phase. The longitudinal and vertical motion 
of a locomotive body can be seen by analyzing the relative motion of the arm 
tip on the coordinate system peculiar to the slider cranks. For this 
reason, the locomotive stability of a locomotive body can be evaluated by 
examining the motion performed by the arm tip in a fixed position. 


The ideal locomotion of a locomotive body occurs along a trajectory at a 
constant velocity. In this connection, therefore, 1) the vertical motion 
of a locomotive device: orthogonal to trajectory; and 2) inconstant 
trajectory motion, during the locomotion of a locomotive device will be 
examined here. 
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4.1 Vertical Motion 


The oscillatory motion orthogonal to the trajectory of a locomotive body can 
be evaluated in terms of the nonlinearity of the path and of the vertical 
velocity and acceleration of the arm tip. 


The vertical oscillation during the locomotion of a locomotive body reduces 
to its optimum value when the tip path of the arm of the slider crank 
mechanism in Figure 2 becomes increasingly straight and parallel with the 
x-axis, when */2 < @ < 3/2«. The linearity of the path during the standing 
leg phase is defined as 


ar·u / να) «@)'" (10) 


This is illustrated in Figure 9, with link length ratio c/b and AT taken for 
the horizontal and vertical axes. The above equation represents the mean 
square of the inclination of the path. When a/b = 1.6 and c/b = 6.6, AT 
becomes a minimum and the arm path becomes most similar to a straight line. 




















Figure 9. Locomotive Stability Based on Locomotive Path 


The y-velocity of the arm tip is obtained when the locomotive body 
oscillates vertically. Its optimum value is 0. For the purpose of its 
evaluation, it is defined as follows: 


= — — 
au⸗ (ism u⸗n⸗· 40) a1) 


Figure 10 shows the value of the y~-velocity when the input turning angle 
velocity is kept constant. Since it is small, the vertical oscillation is 
also small, providing high stability. Value 4 Vy is a minimum when 

a/b = 1.6 and c/bd = 6.6. 


The y-acceleration of the erm tip is defined as follows: 


have (im fo" aryrann® 40°" 12) 


Since the value is small, vertical oscillation is small, providing a high 
stability. As shown in Figure 11, value AAy is a minimum when a/b = 1.6 and 
c/b = 6.6. 
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Figure 10. 

















Figure 11. Locomotive Stability Based on y-Acceleration 
4.2 Movement in Trajectory Direction 


The inconstant movement in the trajectory direction is caused by the 
inconstant velocity or acceleration of a locomotive device. It can be 
evaluated in terms of the velocity and acceleration of the arm tip. 


The average x-velocity Vx of the arm tip is defined as follows: 


teel/ oan 
"Ji, wh 40 (13) 


Velocity variation is defined, as follows, using the mean velocity value Vx 
and the mean square of the difference between the velocities of each point. 


Lal — — 
ate q/a V· 40) (14) 


This is shown in Figure 12. Since value AVx is small, the velocity is 
highly constant, stabilizing locomotion. The locomotion velocity variation 
is the smallest when parameter c/b is 6-7. 


Acceleration is 0 when the arm tip moves at a constant velocity. 
Acceleration occurs when the velocity varies. The instability of movement 
can be evaluated in terms of acceleration. 


an · 
3 "* 40) (15) 
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Figure 12. Locomotive Stability Based on x-Velocity 





As shown in Figure 13, value 4Ax is small, providing high stability since 


value a/b is large. 
os 

















Figure 13. Locomotive Stability Based on x-Acceleration 


It has become clear from the above description that the locomotive velocity 
is highest when the link ratio a:b:c of the slider link is 1.6:1:6.6. 


5. Conclusion 


Basic study was conducted involving a robot locomotion technique necessary 
for developing an automatic system to stretch and saintain aerial 
communications cables. 


(1) A locomotion method that ensures the step over of obstacles on the 
trajectories and its mechanism vere proposed. This proposal makes 
locomotion easier than that involving legs which is carried out by 
controlling a number of actuators. 


(2) <A suspended locomotive device, whose legs employ a slider crank 
mechanism, that performs approximately linear motion has been designed and 
the locomotion of the locomotive body has been formulated kinematically. 


(3) The locomotion stability of the suspended locomotive device has been 
determined by analyzing the motion of the slider crank mechanism and 
evaluating its oscillation caused by the velocity, acceleration, etc., of 
the link. As a result it was learned that the link ratio of the slider link 
crank mechanism that ensures most stable locomotion is 1.6:1:6.6. 
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Development of Wheeled Wall Surface Valking Robot 
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[Article by T. Sato, T. Pujisawa, Y. Tanaka, and A. Hagio, Nippon Kokan 
K.K.] 


[Text] 1. Introduction 


There is a growing tendency to automate the inspection and repair aspects 
involved in maintaining ofl tanks, globular tanks, and other large plant 
structures, as well as ships and vessels. Robots used for this purpose 
would move while adhering to the wall surface. They are, therefore, called 
wall surface walking robots. Study and development is now underway 
regarding robots employing a variety of adhesive and locomotive mechanisas. 


The adhering-walking systems of wall surface walking robots can roughly be 
divided into wheel and crawler walking systems, with built-in permanent 
magnets, and vacuum walking systems (there are also intermediate type ones). 
The former require no suction energy and show a high locomotion velocity. 
However, their disadvantages are as follows: the wheel systems are not 
capable of generating any substantial adhesive force and crawler ones are 
not suitable for spherical and stepover walk. On the other hand, the 
latter's strength is that it is capable of generating « large adhesive 
force, but its weakness is that its operation is performed intermittently 
and slowly. The systems function opposite to each other. The choice 
between them should be made after taking application purposes, environmental 
conditions, etc., into account. They are applied to structures with varied 
curvatures, such as cylindrical and spherical ones. None of the 
aforementioned systems are applicable to all wall surface shapes. 


The authors have developed a walking robot with a permanent-magnet wheel 
system and a constant adhesive performance that is applicable to various 
wall surface shapes of steel structures. It will be summarized here. 


2. Principle of Development 


The robots gust offer the following characteristics for the flaw detection, 
cleaning, painting, etc., of large structures. 
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(1) Capable of free locomotion, saintaining stable adherence to vall 
surface. 


(2) Applicable to fault, curved, and spherical surfaces, as well as 
surfaces with steps, such as weld beads, etc. 


(3) Will not damage the coat of the wail surface. 


(4) Capable of maintaining safety, even during power failure or other 
unexpected accident. 


(5) Capable of being self-standing. 


Specifically, items (1) and (2) can be said to be the most important 
functions for increasing the automaton and efficiency of various kinds of 
inspection and other jobs. 


In this study, the authors developed a highly universal wall surface walking 
robot, setting up the aforementioned five items as development targets, and 
employed a magnetic adhering wheel walking system with a permanent magnet 
as the basic mechanism attain the targets. 


3. Structure of Wheeled Vall Surface Valking Robot 
3.1 Overall Construction 


The robot consists of a walking system with four sets of magnetic adhering 
wheel units and two DC motors for driving two sets of right and left wheels, 
a probe for inspection purposes, an arm to conduct various jobs, gripping, 
cleaning and painting devices, a TV camera monitor, sensors (walking range 
finder and posture detecting inclinometer) to provide information about the 
robot's status, and a controller to control the walking of the robot and the 
operation of the arn. 


In order to decrease the weight of the system body, the basic structure has 
been simplified and its main part is mostly composed of hard aluminus. Its 
steering is performed toward the low-speed side by giving a speed 
differential to the right and left systems of the wheel units. This 
structure is also aimed at structural simplification and weight reduction. 
Figure 1 shows its appearance and Table 1 the main specifications of the 
walking systen. 


3.2 Wheel Structure 


The magnetic adhesive wheels with built-in permanent magnets have a 
structure in which a hollow disk magnet is placed between two disk yokes. 
Therefore, only the yokes come into contact with the adhesive object 
surface, and no load is imposed on the brittle magnet. This is of rare 
earth cobalt, with high magnetic characteristics. The wheel structure is 
shown in Figure 2. 
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Figure 1. Wheeled Wall Mobile Robot 
Table 1. Main Specifications of Mobile Structure 





Length 515 a= 
Width 420 =n 
Height 135 oo 
Weight 38 kg 

Main actuators DC motor x 2 
Number of wheels 8~12 

Total magnetic force 300 kgf< 
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Figure 2. Magnetic Wheel 


Such disk-type yokes come into point- or line-contact with the steel 
surface, so magnetic force lines are concentrated on this small contact part 
to saturate it. The wheel-type magnetic adhesive system was faulty in that 
the adhesive force obtained was limited. When wheels are increased in 
quantity or size, however, the system becomes complicated or increases in 
weight, unavoidably lowering the walking performance although the adhesive 
force increases. 


The authors, therefore, attempted to increase the adhesivw force, while 
changing the wheel structure only slightly, by improving the contact area 
between the yokes and steel surface. Figure 3 shows an example of 
experimentally manufactured yokes. All types of yokes demonstrated an 
increase in adhesive force of 20-50 percent, and nearly the same increase 
in the frictional force that determines the posture stability at 
perpendicular wall surfaces. Specifically, polygons facilitate an increase 
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of the contact area, and their effect can be said to be great. 

case, however, it was necessary to take a countermeasure to the increase 
the walking oscillation and load. The adhering force of the 
polygonal yokes shown in Figure 3 amounted to 54 kgf. 
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Figure 3. Yoke Shapes of Wheels 
Double wheels, such as those shown in Figure 4, also have a structure 
suitable for easy application. They offer flexibility in setting the 
adhesive force to cope with the increased load. 
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Figure 4. Double Magnetic Wheels 
3.3 Curved Surface Adhesive Mechanisa 


The ability to adhere is significant, first of all, for the adhesive and 
walking stability of all adhesive systems. In order to secure stability and 
reliability, adhering devices not only must have a high adhesive capability, 
but also each gust be able to adhere to wall surfaces of varied shapes. 


When a walking system is applied to a wall surface with a certain curvature, 
adhering devices should be located so that they operate orthogonally to it. 
In this case, however, they cannot be applied to wall surfaces with varied 
curvatures. When applied to a wall surface with a curvature or with steps, 
such as weld beads, etc., as described above, a fixed location of the 
adhesive devices, as well as a flexible support mechanisms for them, is 
required. In this study, the authors developed an adhering mechanics 
universally applicable to surfaces: with varied curvatures. It will be 
summarized here. 
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The wheel units have a structure in which two sets of independent wheels and 
a gear box are installed on a common frame, as shown in Figure 5. The 
entire structure has a turning freedom of 230° horizontally, and each of 
the wheels has an independent turning freedom of 25° horizontally. They 
work quite independently to ensure curved surface adhesion, as shown in 
Figure 6. Curved surfaces are, therefore, subject to similar adhesive force 
as are flat surfaces. These functions are useful for stepping over vweid 
beads, etc. Since the other wheels do not separate from the wall surface 
face when encountering steps, as shown in Figure 7, no impact occurs when 
the wheels are attached or detached, minimizing the decrease in the adhesive 
force. Figure 8 summarizes the wheel unit mechanisa. 








< | Wheel wll retetion 


Figure 5. Wheel Unit Figure 6. Wheel Unit on Curved 
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Figure 7. Surmounting an Obstacle Figure 8. Transmission of Wheel Unit 
Surface 
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The body support of two sets of rear wheel units is given an extension 
freedom, as shown in Figure 9, for the stable adhesion of the entire walking 
system structure to curved surfaces, etc. This mechanism enables the four 
sets of wheel units to maintain stable adhesion, even to curved surfaces, 
without causing gutual interference. 


The walking system, on the other hand, employs a body bending mechanisa, 
such as that shown in Figure 10. It makes the system applicable even to 
surfaces with such small curvatures that application would not be possible 
with the turning freedom of the entire wheel unit structure alone. It is 
useful for the walking system when axially walking along the inside and 
outside surfaces of large-diameter steel pipes, for example. 


The aforementioned mechanisms ensure that the stable adhesion of the walking 


system to curved and bent surfaces with varied curvatures, as well as to 
surfaces with weld beads and steps, and walking on thee 
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Figure 9. Structure of Rear Wheel Unit 











Figure 10. Transformation of Robot Body 
3.4 Protection of Vall Surface Coat 


It is not permissible for a robot walking on an object structure to damage 
its coat. The possibility of this damage has been an intrinsic defect of 
wheeled magnetic adhesive systems whose area of contact with the wall 
surface is small. Therefore, the authors attempted to decrease the 
compressive force working per unit area of coat by increasing the area of 
contact between the wheels and the wall surface. As a result, its utility 
was confirmed since the coat was not affected. 


In this connection, it is necessary to examine the problem involving the 
decrease in adhesion caused by the gap that occurs between the wheels and 
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the wall surface. The adhesion of a walking system with a gap of 0.8 mm 
(assumption: coat 0.3 mm, urethane coat 0.5 mm), for example, is obtained 
from Figures 11 and 12. The adhesive force of the eight wheels obtained by 
covering polygonal yokes with urethane is estimated as follows: 


Adhesive force = 304 kgf (432 kgf) 
Frictional force = 158 kgf (102 kgf) 


where the values for a walking system in which no gap with the wall surface 
is formed are parenthesized. 


Friction coefficient 
o ° 
; -~ 
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Figure 11. Relationship Between Figure 12. Relationship Between 
Magnetic Force and Gaps Friction Coefficient and 
Wheel Shapes 


As stated above, the frictional force increases although the adhesive force 
decreases by about 30 percent. It can be said that this small amount 
obstructs the walking stability of the walking system on a perpendicular 
wall surface. The urethane rubber covering of the yoke’s outer 
circumferential surface is effective in protecting the coat of the wall 
surface. The decrease in adhesive force should be minimized in order to 
secure the reliability of the walking system during ceiling or stepover 
walking. When the gap exceeds 1 mm, it is necessary to take certain 
measures, such as the application of double wheels, as mentioned above. 


The method of setting the adhesive force and quantity of wheels will be 
described below for reference. 


Uxn=-pxFxN 
300 < Fx N 


where VW: total weight (kgf) of system 

slip safety factor (2<) 

wheel-wall surface friction coefficient 
adhesive force per wheel (kgf) 

quantity (pieces) of wheels 


zx1t 3 
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It is necessary to make the setting on the side of safety when the 
coefficient of friction among the wheels and wall surface and work 
environment is not favorable (wind, vibration, etc.) 

3.5 Control Systen 


Figure 13 summarizes the robot’s control systen. 
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Figure 13. Robot Control System 





The control system consists of a sensor to provide information regarding the 
robot's status (walking range finder and posture detecting inclinometer), 
servoamplifiers for driving motors and a microcomputer. It is controlled 
remotely using an exclusive-use operating panel. 


The main features of the system are as follows: 


(1) Enables a robot to engage in self-standing operation since all the 
units required for its operation and control are mounted thereon. 


(2) Provides instruction for operation by simply transferring a simple 
command to the robot from the operation panel. A universal computer with 
an RS-232C interface can be substituted for it. 


(3) Capable of setting the walking speed of the robot, the operation speed 
and positioning of the arm, etc , as desired, and setting up various work 
conditions involving flaw detection, etc. 
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4. Walking Test 
4.1. Walking on Perpendicular Flat Plate 


In order to grasp the basic walking performance of the robot, the authors 
tested it on a perpendicular plate such as that shown in Photo 1 [not 
reproduced]. The walking plate is made from hot-rolled plate (mill-scale 
surface), and eight polygonal wheels are employed. 


The results of the walking test will be described collectively per test 
level. 


(1) Perpendicular walking 


both while ascending and descending, the robot demonstrated stable walking, 
causing no slip to occur between the wheels and wall surface. Figure 14 
shows its walking speed characteristics. At that time, its maximum value 
was about 9 m/min. 








Set 
Figure 14. Moving Speed of Robot 


The robot also demonstrated stable walking when loaded with about 50 kgf. 
(2) Turning 


The robot was provided with a mechanism to enable low-speed side turning by 
giving a speed differential between the right and left wheel unit systems. 
Its turning performance was good, with its turning radius varying inversely 
with the speed differential. 


(3) Stepover walking 


The stepover test employed a simulating bead (maximum step 6 mm), parallel 
to the walking plate. As a result, it was confirmed that the robot could 
continue to walk stably, with its wheels not rising, when stepping over the 
bead vertically (both wheels used at a time) and obliquely (each wheel used 
alternately). 
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(4) Walk employing urethane covered wheels 


The authors conducted this walking test using wheels made by covering the 
outside of the yokes with urethane rubber and coated with a tar epoxy (coat 
thickness 0.2-0.3 mm). As a result, they confirmed that walking was 
performed without damaging the coat surface. No sudden turns should be 
carried out, or else the urethane cover or coat surface might be slightly 


damaged. 
4.2 Actual Plant Test 


The authors tested a robot's walking ability using a 2,000 m’ accumulator 
($15.6 m) installed at Nippon Kokan in order to grasp its actual walking 
performance and acquire data for its practical application. Testing 
conditions are shown in Photos 2 and 3 [not reproduced]. 


The test specifications of the wheels are as follows: 
Shape: polygonal (urethane cover 0.6 mm) 
Quantity: 12 pieces 
“Sticking force: 312 kgf 
Frictional force: 156 kgf 
“Estimated from the value obtained by measuring separate wheels; 
nominal thickness of accumulator coat: 0.3 mn. 


As a result, it was confirmed that all wheels demonstrated stable ascending 
/descending, horizontal, turning and other walking operations in close 
contact with a spherical surface without damaging the coat of the 
accumulator at all. 


5. Conclusion 


The authors developed a magnetic adhesive wheel wall surface walking robot 
applicable to structures with varied curvatures. It attained a high walking 
performance (maximum walking speed 9 m/min), and was free from the defects 
found in conventional wheeled robots, such as insufficient adhesive force, 
inflicting damage to the coat of the wall surface, etc. 


The robot was also confirmed to be capable of engaging in stable adhesion 
and walking through tests involving stepping over weld beads, walking on the 
spherical surface of actual plants, etc. 


The robot is applicable to maintenance jobs of various kinds required by 
large plants. 
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[Article by Yoshio Mizugaki and Masafumi Sakamoto, Kyushu Institute of 
Technology, and Hidehiko Yamada: “A Method To Automatically Form Robot’s 
Obstacle Avoidance Path in Lattice Point Space") 


[Text] 1. Introduction 


The recent demand for intelligent mobile robots has appeared in the forms 
not only of industrial unmanned carriers, but also for civil engineering and 
building work, as well as for nuclear plant, offshore development, disaster 
control, and other critical work. Therefore, society's needs for practical 
intelligent locomotion robots, rather than regarding mobile robots as an 
object of artificial intelligence study as has been done in the past, have 
increased. To develop these intelligent locomotion robots, research to 
understand the sensor-using environment and make orbit planning and guidance 
control intelligent is more necessary than ever, not to mention research 
involving locomotive functions, such as locomotion mechanisms and control 
methods. 


Specifically, the problem involving obstacle avoidance by robots has long 
been studied in connection with research on artificial intelligence and is 
a central task, along with the study of robot language. 


The problem of obstacle avoidance is deeply involved with understanding a 
robotized environment, and its important themes include describing working 
environments and modeling them in the computer. Accordingly, one can 
conceive of a method using environmental models, consisting mainly of 
geometric models, end a method using potential fields, including penalty 
functions. In this study, we basically take the former position and have 
devised what may be termed “blackboard utilization,” rather than using 
models, by limiting the path searching space and simplifying the obstacle 
description. Hence, this report. 








2. Lattice Point Space and Problem Setting 
2.1 Lattice Point Space 


When considering a path to avoid obstacles, it is important to select 
solution searching space. In the case of a manipulator, generally a 
nonlinear mapping relationship exists between the space which a link 
variable forms and the real work space of the end effector, with the mapping 
relationship differing from one link structure to another. It is, 
therefore, desirable to use the real work space of an end effector or its 
configuration space (C-space), when searching for an obstacle avoidance 


path, as a space shape. 


Space, whether real work space or C-space, is treated as a continuous body 
and, in collision detection, interference between the coordinate value of 
the obstacle and that of the path must exist. However, since such numerical 
computation imposes a substantial load on the computer, a simpler method of 
collision detection is preferable. 


Therefore, let us consider lattice point space, in which the coordinate 
value of the real work space is discretely quantized. In the case of 
lattice point space, obstacles are treated as aggregates of lattice points. 
Therefore, in interference operation, all that has to be done is to count 
lattice points. Also in this study, hemispace, in which only the 
z-coordinate positive direction (2.5-dimensional space) is taken into 
consideration, is used as the path searching space. This is due to the goal 
being a simple path-forming method in which the space and problems are 
limited. The limiting of the shape and position of obstacles involving 
problem setting was carried out as follows: 


2.2 Problem Setting 


We assumed a lattice point plane in which the lattice point space was 
projected onto an xy plane, and coordinated it with the CRT graphic picture 
plane of a personal computer. Therefore, lattice points correspond to dots 
on the graphic picture plane. (The graphic picture plane is the xy plane 
with a z-coordinate of zero.) The height is basically indicated by the dot 
color, and the height range is definite according to the color code 

(Table 1). 


Table 1. Range of Height of Color Information 








Color code Height range Z max: maximum height 
1 (blue) 0 <Zmax< 500 

2 (red) 500 < Z max < 1,000 

3 (purple) 1,000 < Z max < 1,500 

4 (green) 1,500 < Z max < 2,000 

5 (light blue) 2,000 < Z max < 2,500 

6 (yellow) 2,500 < Z max 
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Basically, only polygonal objects are used as obstacles. Each must have 
a convex-polygonal base and be in a sweep shape which stands out in the 
z-direction. Obstacles must rest on the xy plane of the z-coordinate of 
zero. The top of the prism must be cut off by a horizontal or sloped plane. 
If the top is sloped, the color of the highest point of the slope (highest 
point of apices in the cut-end cross-sectional shape) is used as the color 
to indicate the obstacle. 


As the locomotive device to avoid obstacles, we assume the end effector of 
the robot. The end effector is composed of a peripheral quadrangle with 
lattice points in the center (Figure 1). Im this study, the obstacle- 
avoiding path is the path of the central lattice points, avoiding a 
collision between the peripheral quadrangle and the obstacles. The attitude 
change of the locomotive device is not taken into account. 


No 
A 


Figure 1. Lattice Point Space and Problem Setting 
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The start and the goal are given by the combination of x, y, and z 
coordinate values, and the lattice points corresponding to the x and y 
coordinate values are shown on the CRT. 


3. Algorithm 
3.1 Basic Method 


The basic method used to form a path consists of constructing a straight 
path from the start to the goal, detecting possible collisions and searching 
for a point of avoidance in case of collision. If the point of avoidance 
is assumed, the above processing is recursively carried out for a straight 
path from the starting point to this point of avoidance and, if no collision 
is detected, the point of avoidance is established and is used at the 
subsequent starting point. Figure 2 is the flowchart of this basic method. 


The obstacle avoiding path is, therefore, a broken-line path and, as a 
standard for evaluating it, the path length should be considered. If the 
first possible solution (paths) from the start to the goal is obtained, 
compute the length of this path and use it as the shortest path length. 
When checking for other solutions search only for solutions that may be 
shorter than this shortest path. If a shorter solution is obtained, use it 
as a new shortest path and repeat the search for other solutions. 

Figure 3 illustrates this vertical path searching process. 
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The path length is used to decide whether searching should be continued 
whenever the search for an avoidance path is conducted. In other words, 
when searching for an avoidance point by collision detection, if the length 
of the path passing through the assumed new avoidance point exceeds the 
length of the hitherto shortest path, try other avoidance points. 
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Figure 2. Flowchart of Search for Avoiding Path 
(by PAD method) 











Figure 3. Vertical Path Searching and Back Track by Path Length 
When searching, for instance, for a path from the avoidance point vl to the 
goal in Figure 4, obstacle 2 is encountered at b, therefore, avoidance 
points vll, vl2, and vl3 are tried in that order. In the case of avoidance 
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point vl3, the total path length is 1,690 if it is computed frer 630 and 
760, the distances found, respectively, for vll to vl3 and vl3 to tne goal. 
Therefore, the total path length via avoidance point vl3 is at least 1,690. 
Since this is longer than 1,500, the length of the hitherto found shortest 
path (via avoidance points vl and vl2), it can be seen that avoidance point 
vl3, in view of the path length involved, is not an avoidance point to 
pursue. Vertical searching is conducted by first trying all avoidance 
points from vl down, and then similarly trying avoidance point v2 and v3. 














— — 


Figure 4. Setting of Avoidance Points and Searching Process 





3.2 Straight Peth 


The straight path from the start to the goal in lattice point space is 
formed as a lattice point row by the DDA (digital differential analyzer) 
method. 


In the DDA method, an axis whose coordinate components have the largest 
displacement of all x, y, and z coordinate differences for the start and the 
goal is used as the standard axis, and lattice points on the plane of the 
components of the other two axes are determined by changing each dot along 
this axis. 


When using the DDA method, good approximation and resolution depend on the 
size of the lattice notches. In this study, notches are believed to be 
sufficiently small since the dots on the CRT graphic picture plane 
correspond to the lattices on the lattice point space. 


Take, for example, y-coordinate value computation when a straight path is 
formed along the X-axis from the start S$ (Xl, Yl, and Zl) to the goal G (X2, 
Y2, and 22) by the DDA method. (Each coordinate value is an integer.) 


OX = X2 - Kil, SY = Y2 - Yl 
1 aXl > aY 


Introduce R(i), which corresponds to the remainder at the lattice point for 
the number of times of repetition i (N >i, N= 14X1). R(i) is defined by 


R(i) = 14Y1 x i - lal x k 
1 aXl > 1 R(i)1 


or by R(i) = (R(i-1) + SY) mod AX, and the coordinate values X(i) and Y(i) 
of the first lattice point can be obtained by 





rci) = Ei + egelOt)x i 
= (il) + eeeta®) 
Ta) = Vt + egeetaroxe 
* Y¥i-t) 
mi Rmci-tpeatvi < tant) 
= Y¥Ci-t) + egeta) 
<iemc-ieart @ tant) 


Here, sgn(AX) is a code of 4X and takes either of the 11 values. 
3.3 Collision Decision 
3.3.1 Prise 


The collision decision is made by successively deciding whether the lattice 
points in the peripheral quadrangle are in the interiors or exteriors of 
obstacles when the center point of the end effector moves along a straight 
path. Basically, the interior/exterior decision is made by the relative 
height of the z-coordinate values. Specifically, it is made by projecting 
lattice point spaces along the path on the xy plane and comparing the height 
of the straight path as these plane lattice points with the height of the 
obstacles. 


As stated in the problem setting section, plane lattice points are colored 
according to the height of obstacles if they exist. If they do not exist, 
the lattice points are shown in white, the color of the work plane. Black 
is for the outside of the work plane. 


Therefore, if the height of the space lattice points on the straight path 
is within the height limits determined by the color of the lattice points 
denoting obstacles, the possibility exists that the path will encounter 
interfering obstacles. 


In this case, a detailed collision decision is made by the following 
procedure: 


(1) Identifying the obstacles to which the plane lattice points noted 
belong; and 


(2) Determining the height of space lattice points on the surfaces of 
obstacles from the coordinate value data for the apices of the obstacles. 


This procedure basically depends on the expression of data involving the 
obstacles and the way in which they are kept. Regarding obstacles, the 
convex polygon apex on the base and the z-coordinate value are input, 
vocally or numerically. The data are kept in the form of colored dots on 
the CRT graphic picture plane. On the program, only the list of coordinate 
values of apices remains. Figure 5 shows obstacle data expressed by Prolog, 
the program description language. As can be seen from this, such details 
as the shapes of the base polygon and the equation for contour lines do not 
appear expli.‘«... Therefore, since the obstacles to which the lattice 





points noted cannot be analytically identified at once, the step in (1) 
becomes necessary. The step in (2) presupposes the case involving a sloped 
top of a polygonal obstacle, and consists of finding the height of space 
lattice points on the slope from the z-coordinate values at obstacle apices 
by the interior division. 


(Obstacle data in Figure 4) 

Obstacles 

(4,1, [ [260,255 , 1500) , [220,220,1500] , (225,240, 1500] , (240,250, 1500) }) 
Obstacles (3,1,[[220, 300, 1000) ,[195,270, 1000) , [ 200,290,800) )}) 


Obstacles (color number, obstacle number in same color, list of apex 
coordinate values) 


Figure 5. Obstacle Data Expression 


The (1) step called dot elimination is described below, and the (2) step for 
the case involving a sloped obstacle top will be stated in 3.3.2. 


Dot elimination is used to identify the obstacle to which the plane lattice 
point noted belongs by repainting obstacles with the color (color indicating 
the height of an obstacle) of that plane lattice point, one by one. 


Suppose, for example, that two obstacles are shown in red, one of which hits 
and collides with the straight path. The lattice point on the path is 
simply red and does not indicate which obstacle it belongs to. Therefore, 
repaint each obstacle domain into another color (white) and see if the color 
of the lattice point noted changes. If it does, it is evident that the 
lattice point belongs to the obstacle that has been repainted and, employing 
the coordinate data of that obstacle, interference is detected. 


When an obstacle is identified by dot elimination, the height of the lattice 
point on that obstacle can be determined. Since the height of the obstacle 
is constant if it is a prism, the height of the lattice point noted equals 
the z-coordinate value of the obstacle p-ulygon apex. If the top is not 
parallel to the xy plane (i.c., if it is sloped), the height of the lattice 
point is determined by the method described in the following section. 


3.3.2 Slope 


If the top of an obstacle is sloped, the height of lattice points is 
computed based on interior division. If an obstacle is in the shape of, for 
example, a cut triangle pole (Figure 6), the z-coordinate values of the 
lattice points are computed by the following equations, using their x and 
y values. 


If the top of an obstacle is a quadrangle or a polygon of a higher order, 
apply the above equations, using (X1, Yl, Zl), (X2, Y2, 22), and (X3, Y3, 
Z3) as the coordinate values for three adjoining apices. 


Determining the possibility of collision is made by comparing this height 
to the height of the path. 
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Figure 6. Determining Slope Height 


3.4 Determining Avoidance Point 


When collision is detected, as seen in Section 3.3, an avoidance point is 
set as an immediate goal either right, left or above an obstacle apex 
according to the Figure 2 flowchart. The order to be followed in setting 
an avoidance point is left, right, and above, facing the goal. The case of 
right or left is shown in Figure 7, while the case of « point is shown in 
Figure 6. In the case of « right or left avoidance point, first decide the 
x and y coordinate values of the avoidance point and then determine its 
z-coordinate value. Im the case of an overhead avoidance point, its x and 
y coordinate values are the same as those of the lattice point noted, and 
all that has to be done is to determine its z-coordinate value. 


Stert ¢ 
Left eweidence 
point 
igh: 
eveidence 
peint 
Steel & « 


Figure 7. Setting of Right and Left Avoidance Points 


For instance, when setting an avoidance point at the left in Figure 9, first 
detect apex B of side AB on which collision position ¢ is found. The 
detecting method involves enumerating apices near point c, one by one, 
observing if point ¢ is on « side which as the apices as the end points, 
and thereby determining apex 8. Then, draw a perpendicular passing through 
B to the straight path, SC, and compute and set avoidan « point L « certain 
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Figure 68. Setting of Overhead Avoidance Point 





Geol 6 . 
Figure 9. Setting of Left Avoidance Point 


Even if setting a right of left avoidance point fails, as in the case in 
which obstacles are close together, setting an overhead avoidance point 
always succeeds since problem setting is for a 2.5-dimensional space. 
Therefore, a solution will always result from this path searching process. 


In setting avoidance points, searching is not necessarily conducted in the 
order of left, right, and above. Instead, the results of prelisinary 
selections are given priority for testing purposes. It is possible, 
therefore, to achieve efficiency in subsequent searching if, for instance, 
an overhead avoidance point is selected. 


4. Test 
4.1. Systen 


The system can be coded, using Prolog Kaba (MS-DOS) on the NEC PC9B01VN2. 
Although its numerical computing function is weak due to the nature of 
Prolog, it is suitable for vertical searching and convenient when adding 
control rules. 


Obstacles are input by designating the positions of convex polygon apices 
on the CRT graphic picture plane. The shape, position, and height of an 
obstacle are designated and input verbally or by keyboard. When designating 
these verbally, the xy and xz planes appear as input picture planes and, 


92 





therefore, the designation is made within thes. In the case of numerical 
input, on the other hand, corresponding points are shown in the xy and xz 
planes. The obstacle position and height that is input are retained in the 
program as the list of the x, y, and z coordinate values of polygon apices 


(Figure 5). 


One characteristic of this system is that it can designate, in advance, 
domains that do not require searching. This is because, regarding collision 
decision by the dot color, it excludes backtracking frea the work domain if 
the dots are black. Specifically, it can make this designation by drawing 
a black line showing the outside of the work domain within the limits of the 
end effector work domain, which is shown in white, on the CRT graphic 
picture plane. Therefore, the domain beyond the black line is excluded fros 
the object of search. 


When executing a program, the lattice point (dot) progress is displayed on 
the CRT graphic picture plane according to vertical path searching. A path 
that becomes disrupted has been abandoned by backtracking because it has 
ceased to be a potential shortest path. 


4.2 Test Examples 
4.2.1 Polygonal Obstacles 


Figure 10 shows an example of the results of avoidance path searching for 
polygonal obstacles with horizontal tops. There are four obstacles: two 
triangular poles and two square poles. The start is (830,100,400) and the 
goal is (-460,570,50). The obstacle height is 300 and 350 for the 
triangular poles and 500 and 600 for the square poles. The avoidance path 
obtained is expressed as a list of avoidance points and 


[ (830, 100,400) , (680,350,370), 
(350,410, 350) , (250,420,350), 
(-270,40,210) ,(-4660,570,50)), 


with the path length being about 1,570. 
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Figure 10. Example of Formation of Avoidance Paths 
for Prism Obstacles 
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4.2.2 Polygonal Obstacles With Slopes 


Figure 11 shows an avoidance path for obstacles with slopes. Here, too, 
there are two triangular poles and two square poles, sach with a sloped top. 
The start is (900,900,1000) and the goal is (-900,-200,1500). The avoidance 
path is 


[ (900 , 900 ,1600) , (760,600, 1040) , 
(590 ,520,1150) , (580 ,520,1250), 
(570 ,529,1350) , (560,520,1450), 
(550,520,155) , (160,500,1550), 
(-100, 330, 1650) , (-180,280,1730), 
(-900, - 210 ,1500) } 


and the path length is about 2690. 
The computing time was 6 minutes 55 seconds. 
5. Conclusion 


In order to automatically generate collision avoidance paths for robots, we 
have used Prolog to devclop a vertical path searching process characterized 
by lattice point space, which utilizes the color informa':ion of these 
lattice points. It consists of deciding, by the color of the lattice 
points, whether obstacles exist in a 2.5-dimensional space and setting 
avoidance points, taking the path length into consideration. The following 
is the conclusion reached threugh the development and testing of this 
method: 
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Figure 11. Example of Formation of Avoidance Paths for 
Obstacles With Slopes 
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(1) We were able to simplify problems by using lattice point space as path 
searching space and to develop a system easy to understand visually by 
coordinating lattice point space with the CRT graphic picture plane. 


(2) The path searching algorithm is easy, but problem setting for complex 
three-dimensional obstacles, etc., is impossible since the CRT graphic 
picture plane is te domain of the obstacle data expression, and other work 
is necessary for collision decision. 


In the future, the system must be made applicable for such purposes as path 
searching in joint angle space in order to assure the noncollision »f wot 
only the end effector, but the link mechanism as well. 
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{Text} 1. Introduction 


It is absolutely necessary for locomotion robots to be able to avoid 
collision with not only fixed obstacles, but also obstacles that move 
(mobile objects). To enable a locomotion robot to move while avoiding 
mobile objects, it is necessary first to recognize the status of movement 
of mobile objects by modeling a mobile environment and then form a 
locomotion plan according to this recognition so that the robot can avoid 
collision. 


The problem of avoiding collision with a mobile object has been handled in 
military and shipping areas as involving collisions or encounters between 
mobile objects themselves. However, the motion of locomotion robots 
involves the difficulty of description or analysis using differential 
equations since it contains many intermittent moves and because the boundary 
conditions of the environment must be considered.’ Therefore, the problem 
of collision avoidance by locomotion robots is sometimes proposed as 
something different than that encountered in the past. There have been, for 
example, the following studies: 


Regarding the problem of avoiding collision with fixed objects, studies have 
used mathematical models.**> Famous cases having realized practical 
collision avoidance include a study using a guide dog robot‘ and, as more 
general cases, the study of the Stanford Cart’ and that by the American ALV. 


As for the problem of avoiding collisions with mobile objects, a study was 
conducted in which mobile objects were measured, using an ultrasonic 
measuring system, and the mobile objects were tracked or, if a mobile object 
crossed in front, control was exerted by waiting until the object passed. (6) 
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Then, regarding the problem of avoiding collisions between several robots 
and fixed objects, a study was conducted using mathematical modes.’ This 
study is aimed at resolving collision avoidance problems of this kind by 
monitoring and controlling the overall behavior of several robots and fixed 
objects by a system called "coordinator." 


By contrast, this paper discusses the problem of initiating an active 
avoidance action against an oncoming object, realizing collision avoidance 
by a visual system, and, in the absence of a system to monitor and control 
the behavior of the locomotion robot and the mobile object simultaneously, 
avoiding the collision of the self-contained locomotion robot against the 
self-contained mobile object.®:*® 


In this paper, first we propose a method to determine whether the mobile 
object will collide with the robot, then describe the rationality of 
collision avoidance, propose a method to form collision avoiding paths, plan 
collision avoiding paths, plan collision avoiding actions, discuss cases in 
which these methods have been applied to a limited moving space and explain 
the composition of the system that is the target of this study. Finally, 
we describe the basic test conducted, using a small experimental system, 
involving collision avoidance with mobile objects in a limited moving space. 
The movement of mobile objects is detected by the robot itself, using 
heuristic functions to evaluate the relative motion between the robot and 
the mobile c\ject. The collision avoidance movement is planned by forming 
a collision avoidance path, using the values of the heuristic functions. 


As premises of this study, the following is assumed: 


Only one mobile object is used for the collision. With the exception of 
walls, the moving space contains no fixed obstacles, such as desks or 
chairs. The mobile object moves at a constant speed. The robot also moves 
at a constant speed, except when conducting a collision avoidance action. 
The locomotion robot can recognize the position, moving direction, and speed 
of the mobile object with a field of vision of 360° by means of a visual 
system. The robot and the mobile object can be approximated as circular. 
The locomotion robot has a predetermined locomotion path and its collision 
avoidance action is deemed a temporary, special step. 


2. Determination of the Collision Possibilities 


This chapter proposes a method to decide whether a locomotion robot will 
collide with another mobile object. 


With this method, the determination of the collision possibilities is made 
based on the following rule of thumb: “Was the mobile object located in 
the direction in which the locomotion robots are heading and, when the 
distance of the object to the robot decreases, it is always certain that it 
collides with the locomotion robot.“ 


The reason for using this rule of thumb is that, in order to enable the 
locomotion robot to realize collision avoidance on a real-time basis by 
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means of a visual system, it is preferable to use a method by which a 
conclusion can be obtained directly from the picture, rather than to subject 
data from the picture to complex processing. 


In this study, we have prepared heuristic functions based on this rule of 
thumb and designed to evaluate the relative motion necessary to determine 
collision possibilities. 


These heuristic functions are of two different types: local functions and 
general functions. The local functions are used to evaluate the risks of 
collision with the mobile object within a certain period of time. The 
general functions, on the other hand, are used to evaluate the risks of 
collision with the mobile object for as long as the robot can observe. 


The local functions comprise two types: collision direction degree F and 
collision wide angle degree M. 


The general functions comprise two types: moving angle record D and 
approach degree L. 


The above functions can be obtained from the observed values of the mobile 
object collected in period t. “Observed values" refers to the measured 
values of the relative position of the mobile object and the robot. The 
observation period t can vary according to the extent of the mobile object's 
speed change and the capability of the robot. The decision regarding 
collision possibilities is extended by deleting the limiting of the mobile 
object to only constant-speed motion, so that the free motion of the mobile 
object can also be evaluated. However, this limitation is binding as far 
as generating collision avoidance paths is concerned. 


2.1 Collision Direction Degree F and Collision Wide Angle Degree M 


The values of F and M are obtained by evaluating the continuous n-times 
value obtained from periodic observation of the mobile object. The values 
of n are obtained by adding new data and deleting the oldest data on each 
occasion of periodic measurement. They can be increased if the change of 
motion of the mobile object, based on its migration, is relatively large. 
If n= 1, the possibilities of collision can be determined easily. All that 
has to be done is a check to see if the relative movement vector of the 
robot and the mobile object points to the robot. 


However, in reality, it is dangerous to determine the collision 
possibilities by n = 1 because it is thought that, even if the mobile object 
is moving at a constant speed, some variations in the data obtained by the 
robot from measuring the position of the mobile object will occur. In this 
method, therefore, the collision possibilities are determined by referring 
to continuous n-time data. 


Here, R is the position of the robot and 0., is the position of the mobile 
object measured i-times previously (Figure 1). V, is the movement vector, 
with 0., as the beginning point and 0.,,, as the end point. b, is the vector 
component of V, in the direction of the line segment connecting 0., and R 
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with a straight line, and c, is the vector component of V, in the vertical 
direction. Collision angle # is the value measured counterclockwise from 
the movement vector of the locomotion robot toward the movement vector of 
the mobile object. Here, coliision direction degree F and collision wide 
angle degree M are defined by the equations below. In them, W, represents 
weight. The value of weight W, is selected to enable a certain value to be 
given to the recent movement record of the mobile object and a smaller value 
to be given to the older record. In the simulation, n= 5 and w, = n-i+l are 
used. 


P=t W,b, a) 


M=% c, 7, (2) 








Figure 1. Explanatory Drawing To Evaluate Danger 
of Oncoming Obstacle 


Equation (1) may be thought of as an intuitive value to show the extent to 
which the mobile object points to the robot as it approaches, and Equation 
(2) may be thought of as an intuitive value expressing directional 
deflection. 


The values of F and M are used to determine whether the mobile object will 
collide with the locomotion robot or not. 


If 
(F > 0) A (M = 0) (3) 


the possibilities of the mobile object colliding with the locomotion robot 
are high. 


2.2 Moving Angle Record D a. Approach Degree L 


Moving angle record D is computed by the following procedure (Figure 2): 
The robot retains the one-dimensional arrangement for the mobile object, 
counter (k), to record the azimuth in which 0, exists (0 < k < 359). Each 
element of the arrangement works as a counter. The robot measures the 
azimuth of the mobile object per unit time, increases by 1 the value of the 
arrangement element facing the azimuth if the mobile object is approaching, 
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and decreases this value if it is receding. This record seems to generally 
indicate, by the current azimuth of the mobile object and the distribution 
of the degrees shown by the values of recorded arrangement elements, to what 
extent the movement of the mobile object is directed toward the robot. If 
the degree distribution demonstrates a level pattern, the tendency that 
movement will be directed toward the robot is intuitively nonexistent, while 
acute degrees means that this tendency is intuitively high. Approach degree 
L is the record of the straight-line distance between R and 0,. Therefore, 
if the positions of R and 0, are given by coordinates (x,, y,) and (x,, y,), 
approach degree L can be computed by the following equation: 


L = sqrt (x, - x,)* + (y, - y~)*) 
Here, sqrt(A) is the squzre cperation of value A. 
2.3 Evaluation of the Danger of Collision 


The danger of collision of the mobile object is expressed by three state 
variables. One is determined from the values of local functions F and M, 
another is determined from general function L, and the third is determined 
from general function D. Each is indicated by state variable: STATE 1, 
STATE 2, or STATE 3 (Table 1). These state variables can be used to 
determine whether the locomotion robot should act to avoid collision with 
the mobile object, whether the movement of the mobile object should receive 
more detailed evaluation, or to decide the order of priority in evaluating 
each mobile object if several mobile objects are to be evaluated. In this 
paper, we will only discuss whether or not to act to avoid collision. 


Table 1. Dangerous States and State Variables 





(STATE 1) (STATE 2) (STATE 3) 

SAFE (S) NON-INTERESTING (IN) NONSENSE (NS) 
DANGEROUS (D) INTERESTING (I) STRANGE (ST) 
MORE - DANGEROUS (MD) VERY-INTERESTING (VI) VERY-STRANGE (VS) 
MOST - DANGEROUS (MSD) VERY-VERY-STRANGE (VVST) 





2.3.1 State Variable: STATE 1 


STATE 1 can have the five factors listed in Table 1, with the danger of 
collision increasing from the top downward. The character string itself is 
believed to play an important part in the ran-robot interface but, in this 
paper, it is regarded as a mere code without a meaning. This is also the 
case with STATE 2 and STATE 3. 


To a robot, a mobile object is dangerous if the condition in Equation (3) 
above exists. If this condition exists, STATE 1 is DANGEROUS and if it does 
not exist, the state is SAFE. The states from MORE DANGEROUS down are 
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liable to shift, depending on how the DANGEROUS state continues when the 
mobile object is measured. Once the state becomes SAFE, this continuity is 
deleted and the danger is reevaluated. The speed of transition is devised, 
by means of approach degree L, to be slow if the distance between the robot 
and the mobile object is large and change suddenly if the distance is small. 
If, for instance, 0 < L < 5 and DANGEROUS continues more than once, the next 
situation is MOST DANGEROUS. In the case of 10 < L < 15, it is MOST 
DANGEROUS if DANGEROUS continues more than once, and MOST DANGEROUS if 
DANGEROUS continues more than three times. If DANGEROUS continues more than 
four times and if DANGEROUS has alwnys been the case from the start of the 
observation, it is FATAL. 


The above degrees of transition are values dete,mined by the scale of the 
robot, the details entailed in its work, and the extent of change of its 
locomotion. The status expression from DANGEROUS t« FATAL seems likely to 
be more effective when planning actions to avoid collisions with a number 
of mobile objects. Specifically, it can be used to determine the order of 
priority when planning collision avoidance actions. Example: if one mobile 
object is in a MOST DANGEROUS state and anocher mobile object is in a FATAL 
state, avoidance of collision with the latter must be treated as a priority. 


2.3.2 State Variable: STATE 2 


STATE 2 can have the three elements listed in Table 1. If the mobile object 
is at a distance of more than 20 it is NOT INTERESTING, but it is 
INTERESTING if the mobile object is more than 2 but nearer than 20. It is 
VERY INTERESTING if the mobile object is nearer than 2. This state variable 
can be used for robot control when determining the point at which to 
initiate a collision avoidance action and when the robot should refrain from 
acting to avoid collision if the mobile object is at a great distance, even 
though the possibilities of collision are high. 


2.3.3 State Variable: STATE 3 


This state variable is used if the collision avoidance by STATE 1 and STATE 
2 has failed, or it is necessary to measure the mobile object in more 
detail. STATE 3 can have the four elements listed in Table 1. VERY VERY 
STRANGE means that, in the overall evaluation on many occasions, the number 
of times the mobile object has headed for the robot is large, namely, that 
it acts as if it were deliberately headed for a collision. On the other 
hand, NONSENSE means that the number of times the mobile object has headed 
for the robot is very small, namely, that it seldom acts if it were 
deliberately directed toward a collision. 


STATE 3 is computed as follows: Suppose that d, is the absolute azimuth of 
the mobile object, namely, its moving angle DEGREE (DGR) at the current 
position of the robot. Absolute azimuth refers to the angle measured 
counterclockwise, using the front direction of the robot as reference 
direction 0°, when the robot is initiated (Figure 2). The robot can, from 
its current position, measure the direction in which objects, such as 
obstacles, exist, using a visual system and an absolute azimuth. At this 
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time, the sum (integral value) of array counts (count > 0) at the angle from 
(d,.,) to d,.4) is obtained (Figure 2) using the following equation: 


50 (count(s)@ 0) 


Then, find the a that satisfies the condition of SUM-INT (mumber of times 
of measurement x k). INT(A) refers to a maximum integer that does not 
exceec several As. It is believed that the smaller the value of a, the more 
the mobile object tends, as a whole, to be headed for collision with the 
locomotion robot. k is a constant with a value of 1 < k < number of times 
of measurement but, in this paper, 2 is used as its value. STATE 3 is VERY 
VERY STRANGE if a = 0 and NONSENSE if a > 22.5. The other variables are set 
at values about midway through the range 0 < a < 22.5. 
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Figure 2. Movement of Obstacle and Distribution 
3. Method To Generate Collision Avoidance Paths 


In this chapter, we will first discuss the basic concept of rational 
collision avoidance, then the generation of collision avoidance paths and, 
finally, collision avoidance actions based on the paths generated. 
Rationality when studying collision avoidance between a mobile object and 
a locomotion robot probably can be asserted from various points of view, but 
here we define rational collision avoidance as satisfying the conditions 
that “first, no collision occurs, second, the time delay due to the 
collision avoidance action be minimal and third, energy losses due to the 
collision avoidance action also be minimal." 


The method proposed here to generate collision avoidance paths fully 
satisfies the above-mentioned first condition included in the basic concept 
of rationality. As for the second and third conditions, we take the second 
condition to be a practical one “that a collision avoidance path be formed 
so as to pass as near to the mobile object as possible, and that the 
predicted time of collision and the time of completion of collision 
avoidance (to be stated later) be made to agree as well as possible,” while 
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taking the third condition to be an approximate and practical one “that 
sudden acceleration/deceleration control likely to cause energy losses not 
be used for collision avoidance insofar as possible." The method proposed 
here satisfies these conditions. 


3.1 Generation of Collision Avoidance Paths and Avoiding Actions 


The following steps are necessary to generate a collision avoidance path. 
The first step is to estimate paths from the current positions to the 
locomotion robot and the mobile object to the point of the collision 
occurrence (collision occurrence paths F, and F,). The second step is to 
predict the collision segment area and collision point of the locomotion 
robot and the mobile object and set a collision danger area. The third step 
is to determine the point at which the locomotion robot is to initiate its 
collision avoidance action. Finally, the fourth step is to determine the 
point of which the locomotion robot is to end its collision avoidance 
action. Here, the collision segment area is the part common to the zonal 
portion delineated by the pred‘cted moving locus of the mobile object when 
the robot is contracted into a point, and the mobile object is expanded 
proportionally to that contraction and to the moving locus of the robot. 
The collision danger area is the domain occupied by the mobile object 
expanded at the collision point. In generating a collision avoidance path, 
it is necessary to consider the case in which the locomotion robot is in 
the collision segment area before it is known that the mobile object will 
collide with it,’ and the case in which it is outside the collision segment 
area. However, in this paper, we discuss the latter case only. At that 
time, the generation of collision avoidance paths is divided into two types 
according to the extent of collision angle #. One is the case in which 

@ = 0° and 270° > @ > 90° (Figure 3), and the other is the case in which 
90° > #@ > O° and 360° > @ > 270° (Figure 4). Collision avoidance in the 
absence of a coilision angle is treated as a special case in which @ = 0°, 
but this is not discussed here. 


Let us first discuss the former case. 


Collision occurrence paths F, and F, can be estimated easily from the 
premises. F, and F, are the extensions of, respectively, V, and V,, movement 
vectors of the locomotion robot and the mobile object. The predicted 
collision point P and collision danger area S$ are computed from V. and V,. 
The generation of collision avoidance paths begins when the value evaluated 
from approach degree L and relative speed V exceeds a certain value. Then, 
the definition of collision avoidance is as follows: 


"The completion of the locomotion robot's collision avoidance action against 
the mobile object means that the locomotion robot, which should be at the 
collision point at the collision time, is outside the collision danger area 
and is no longer in danger of being involved in a collision." The former 
can be realized by changing the proposed path to one outside the collision 
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Figure 3.1. Situation Involving Oncoming Obstacle and Robot 
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Figure 3.2 Diagram for Theoretical Collision Avoidance 
Ending Point P, 


danger area, while the latter can be realized by controlling the locomotion 
robot from a point where value b,, which is the basis of computation of 
collision direction degree F, is positive to a point where it becomes 
negative. As a collision avoidance ending point, point P,, where b, = 0 (to 
be stated later), is desirable, but we conveniently use point P,, where 

b, < 0, to simplify the computation. Point P, is the point where the 
locomotion robot attains b, < 0 after passing a point in which b, = 0 on the 
collision avoidance path. Therefore, in reality, no problems are involved. 
Point P, is on straight line F,', which crosses segment F, orthogonally at 
Point P and is at length « from P. « is a length set for safety purposes 
to prevent contact between the mobile object and the locomotion robot. The 
value that + can assume varies, depending on the point in the collision 
segment area at which the mobile object and the locomotion robot collide, 
and its maximum value is :,., while its minimum value is 1.:.. tocy and t,.. 
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correspond to the cases in which the sobile object collides with the 
locomotion robot at, respectively, point 0 and point 0°. WNamely, « is 
computed from the position of the mobile object at the time of collision, 
and its value is £8 < « < 2(R, + R,) + 8. Here, R, and R, are the radii of, 
respectively, the locomotion robot and the mobile object, and # is the 
length set for purposes of safety (Figure 3.1). 


Let us next discuss collision avoidance path Cai. 


A collision avoidance path is, as a principle, generated so that it may 
cross behind the mobile object (this is a principle of collision avoidance). 
This means assigning priority to the movement of the mobile object. The 
reason is as follows: 


The mobile objects assumed in tuis paper include humans or locomotion robots 
and, in the collision svoidance action strategy, they are supposed to be at 
an intelligence level equal to, or higher than, that of the locomotion robot 
which is expected to devise solutions for various interference problems 
(e.g., possibilities with other sobile objects) and unforeseen contingencies 
(e.g., appearance of a third mobile object) caused by the collision 
avoidance action of the locomotion robot. Therefore, the locomotion robot 
concerned gust, when acting to avoid collision, not hinder the advance of 
the mobile object insofar as possible, and sus’. de permitted « large measure 
of freedom in selecting actions. This policy is expected to have the 
subsidiary effect of simplifying the collision avoidance action of the 
locomotion robot concerned and making the structuring of a practical 
algoritha possible. 


If an avoiding path cannot be formed, decelerate until the value of STATE 
1 becomes SAFE. We will first examine the case in which the mobile object 
collides with the locomotion robot at point 0. The collision value is 
largest in this case. Here, consider straight line F,." containing collision 
avoidance ending point P, and lying parallel to path F,. Let the locomotion 
robot temporarily switch its path from F, to F," to avoid collision with the 
mobile object. Part of the cosine curve is used for the transition from F, 
to F.". The speed of the robot is controlled so that locomotion robot R may 
reach point P, via path CAR when the mobile object arrives at point 0. At 
this time, point P, can be determined as follows (Figure 3.2). Suppose that 
the locomotion robot is at position R, at tise j while moving along path CAR, 
and the mobile object is at position 0,. Use V, and V, as the moving vectors 
of the locomotion robot and the mobile object. The mobile object's vector 
relative to the locomotion robot is V,. Find point P at which V, vertically 
crosses the segment connecting R, and 0,. Then, the value basic to the 
computation of collision direction degree F, is b, < 0, and position R, can 
be determined as point P,. After the completion of collision avoidance, the 
locomotion robot may or may not return from point P, to path F., depending 
on the purpose of the robot's movement. The case in which the mobile object 
collides with the locomotion robot at 0’ corresponds with that in which the 
collision possibility takes the smallest value, and all that has to be done 
is to generate CAR’ as a collision avoidance path. 
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We shall now observe cases with collision angles # of 90° > @ > 0° and 
360° > # 270° (Figure 4). These are different from the above cases as 
follows: Collision avoidance ending point P, occurs when the mobile object 
is expected to collide with the locomotion robot at point 0, and is at a 
distance R, + R, + # from point 90 behind the mobile object on moving locus 
F,. Therefore, locomotion robot R is controlled so that it will reach point 
P, via path CAR when the mobile object arrives at point 0. This means that 
the recrossing of the newly-generated avoidance path CAR et points other 
than the proposed path F, of the mobile object and point P, can be eliminated 
by setting the collision avoidance ending point P, behind the proceeding 
direction of the mobile object. 


If the mobile object is to collide with the locomotion robot at point 0’, 
point P,, determined by the same method as in the former case, becomes point 
P,". But point P,” is in the domain across segment F., opposite to collision 
avoidance path CAR that is generated when the mobile object will collide at 
point 0. If collision avoidance path CAR" is generated then, the locomotion 
robot tracks the mobile object. In this case, the locomotion robot follows 
the original path F, and point P,’, at which a perpendicular from point P," 
reaches segment F., can be used as the collision avoidance ending point, 
i.e., segment F." and segment Fr are identical. Then, distance between 
segments F. and F." can have the value of 0 < « < (RgtR,) + (RgtR, +8) siné 
(Figure 4). 







Collision 
segeent eres 


Collision 
danger eres 


Figure 4. Other Situations 
Finally, we will discuss collision avoidance actions. 


Here, the locomotion robot's position BR,’ on avoidance path CAR at time t is 
determined as follows: This decision is made by considering position R, of 
the locomotion robot when the absence of collision avoidance is assumed, 
drawing « segment parallel to segment 0-P, from point R,, and computing, 
using the intersection of this segment and path CAR as R,’. Therefore, 
collision avoidance by the locomotion robot can be controlled by gradually 


changing Rt to Rt’. 
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4. Collision Avoidance Test by Simulation 


This chapter concerns the results of the simulation test we conducted to 
show an index of the suitability of this algorithm in regard to avoiding 
collisions with mobile objects. We will first illustrate the generation of 
avoidance paths, and then give an example of the case in which no avoidance 
paths are generated since it has been detexmined that the locomotion robot 
and the mobile object will not collide. Locomotion R, is denoted with a 
contracted point, and mobile object 0,, expanded proportionally to the 
contraction of the robot, is denoted with a double circle (Figure 5.1). 
Subscript i shows the INNER TIME (IT) of the robot. INNER TIME is time as 
defined by the robot itself. In this example, at IT = 0, mobile object 0, 
was discovered and measurement was initiated. In Figures 5.1 and 6.1, 
indication (a,b,c) on the right side (some, on the left side) of the 
proceeding direction 0, involves the evaluation of the darger of collision 
with the mobile object as measured by the movement information 

of the locomotion robot. a, b, and c represest, respectively, STATE 1, 
STATE 2, and STATE 3. 





Figure 5.1 Example of Simulation (Generation of Collision Avoidance Path) 


b L F 























Figure 5.2 Heuristic Evaluation for Figure 5.1 
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Figure 6. (a) Typical Simplified Passages in Buildings 
(b) Example of Complicated Passages 








4.1 Example of Cases Involving Generation of Collision Avoidance Paths 


Here is an example of cases in which collision angle @ satisfies the 
conditions of 90° > @ > 0° and 360° > @ > 270° (Figure 5.1) (an example of 
cases in which collision angle @ satisfies the conditions of # = 0° and 

270° > 6 > 90° was already shown in a KENKYU SOKUHO (RESEARCH NEWS FLASH)®). 


The locomotion robot determines the collision possibilities while moving 
from R, to Rg, and generates collision avoidance path CAR at R,. The danger 
of collision of 0, at R, is in the state of (MOST DANGEROUS, INTERESTING, and 
VERY VERY STRANGE). These three variables are the state variables mentioned 
in Chapter 1. STATE 1 is computed when the values of F and M at R, to R, 
continuously satisfy Equation (3), i.e., STATE 1 begins with DANGEROUS, 
becomes MORE DANGEROUS and changes to MOST DANGEROUS (Figure 5.1). When 
Equation (3) is satisfied, the collision direction degrees from R, to R, 
satisfy the condition F > 0 (Figure 5.2) and the collision wide angle 
degrees satisfy the condition M = 0 (Figure 5.2). Also, in evaluating the 
relative movement of the mobile object for the locomotion robot, the mobile 
object is judged to be headed for a collision (F > 0) and to be approaching 
the locomotion robot straightly, without lateral deflection (M = 0). 
Therefore, the robot separates collision avoidance path CAR, deciding that 
it will incur a collision if it moves along its original path. Then, from 
Rg-R, onward, the locomotion robot moves on the newly-generated collision 
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avoidance path CAR. At R,, 0, is in the state of (SAFE, INTERESTING, and 
VERY STRANCE), indicating that collision has been avoided. The subsequent 
state of the locomotion robot is maintained at SAFE and INTERESTING in, 
respectively, STATE 1 and STATZ 2. Also, STATE 3 changes from VERY STRANGE 
to STRANGE and finally to NONSENSE, and thus the state becomes increasingly 
safe. This shift from danger to safety can also be understood from the 
change of the values of b,, F, and M (Figure 5.2). The change of the b, 
value indicates that the locomotion robot has avoided the mobile object froz 
b; > 0 to b, < 0 for its movement from R,, to R,, and that, furthermore, it 
has shifted to a collision-free state. As can be understood from the 
movement from R, to R, in Figure 5.1, the temporary increase of the b, value 
at Rg and R,, is due to the fact that the locomotion robot and the mobile 
object suddenly approached for a while. This sudden approach is clear from 
the change of the rate of decrease of approach degree L (Figure 5.2). Its 
effect is apparent in the value for F, namely, the variation of the F value 
in the vicinity of R*®. At this time, the state of the locomotion robot may 
be considered to have become temporarily dangerous through the increase of 
F, but no problems exist since STATE 1 is already SAFE. Later, with F 
decreasing and M increasing, the locomotion robot shifted to a state of 
greater safety. Movement angle record D in this simulation is shown in 
Figure 5.3. At the absolute azimuth DGR = 0, the locomotion robot 
discovered the mobile object and no change occurred in the value of DGR for 
the movement angle was high and positive. By this value, the state variable 
of the mobile object, STATE 3, became VERY VERY STRANGE. The movement from 
R, to Rg in Figure 5.1 corresponds to this. At DGR = 10-80, the count was 
relatively even. The movement from R,, to R,, corresponds to this. At 

DGR = 120, the count showed a negative value. This means that b, became 
negative for the movement at R,,-R;,. 


5. Discussion of Case With Limited Space for Avoidance Actions 


In this chapter, the problem of a locomotion robot generating a path for 
avoiding collision with a mobile object will be discussed with respect to 
cases involving limited space for avoidance actions, specifically cases in 
which collision avoidance occurs in passages in buildings. As limited 
space, we will deal with an expanded wall section in a like manner as when 
we contracted a locomotion robot into a point and expanded a mobile object. 


5.1 Limitation of Movement Space 


The forms of passages often encountered by locomotion robots within the 
interiors of buildings are straight, L-shaped, T-shaped, and cross-shaped 
passages, which may be referred to, respectively, as I-shape, L-shape, 
T-shape, and +-shape. It is necessary to study the problem of collision 
avoidance for these four types of limited space’’ (Figure 6(a)). A more 
realistic passage form (Figure 6(b)) is a stretch of I-shaped passages with 
different widths. It is assumed that the locomotion robot has full 
knowledge of the structure of the working space through which it moves, 
i.e., such matters as the presence of walls and their size, and that the 
space contains no desks, chairs or other fixed objects independent of the 
walls. 
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5.2 Baample of Simulation in Limited Moving Space 


The following are the results of our simulation of collision avoidance in 
a +-shaped passage. This +-shaped passage is composed of walls H,, H,, H;, 
and H, (Figure 7). Suppose that a locomotion robot appears from below, a 
mobile object appears fiom the left, and it is known that they will collide 
at the position R, and 0,. The locomotion robot immediately generates 
collision avoidance path CAR by the method proposed in this paper and acts 
to avoid collision. This example shows that the locomotion robot acted in 
accordance with the principle of collision avoidance by crossing behind the 


mobile object. 
‘ew 


* 


Figure 7. Example of Simulation in Limited Space 











6. System Target and Its Composition 


This system is composed of a host computer linked to several locomotion 
robots by radio (Figure 8). The locomotion robots are each composed of an 
educational robot system HERO2000 (Heathkit product) equipped with a CCD 
camera visval system.” The visual system is a stereo visual device using 
two CCD camera” or a Canon 3D visual sensor using a CCD camera.** HERO2000 
has as an existing sensor an ultrasonic sensor that can detect obstacles 
lying within a circular perimeter with a radius of about 3m. The ultimate 
target when searching for mobile objects involves the sensor fusion of the 
visual system and the ultrasonic sensor. The robot has a local map for the 
small domain of the time of movement and can, using the map to identify its 
position, discover an obstacle and determine whether the obstacle is moving. 
The local map is small, using information from the global map provided on 
the host computer. 


The robot is linked to the host computer and can use information stored in 
the memory or can update information. A person can exchange information 
with the locomotion robot via the window system of the host computer. If, 
for instance, a person gives the robot an order to move from one point in 
the building to another, the robot can move to the destination while 
automatically avoiding collision against a fixed or mobile obstacle that 
exists in its locomotion environment. 
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Each of the robots linked to the host computer can move 

path planned by the host computer. There is no problem involving collisions 
between robots for which noncoltision paths have been planned. The host 
computer used is the SUN 3/50. It uses UNIX 4.2 BSD 

LISP, K-PROLOG, and C language. ‘the systems 
computer are as follows: 


Global map management systen 

Noncollision path generating system 

Own position estimating system (on global map) 
Unknown domain searching systen 

Mobile obstacle management systen 

Management system for several robots 

CG-using collision avoidance simulation systen 






































Figure 8. System Composition 


To develop systems, HU68K of X68000 and C language are used for HERO2000's 
picture processing system and the central control system, and B language on 
PC 98's MS-DOS is used for the HERO2000's drive system. The B language 
referred to here is the C-like BASIC filter program developed by the 
authors’ research group. The systems to be developed on the robot are as 
follows: 


OS for robot use (MCMS) 

Local map management systen 

Mobile object monitoring systen 

Collision avoidance system 

Own position estimating system (on local map) 
Visual control and processing systen 

Robot traffic rule applying systen 


Escape system 
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7. Basic Test Using Actual Systen 


The authors conducted a collision avoidance basic test using a small system 
to see if the proposed collision avoidance algorithm could be realized by 
an actual systen. 


The small system used is shown in the dotted-line area in Figure 8. In this 
test, we used an ultrasonic sensor to detect mobile objects. 


The concept cf the test is as follows: 


The locomotion robot, moving at a constant speed through a building passage 
thet has no fixed obstacles other than walls, uses our proposed method to 
avoi. colliding with a single mobile object approaching at a constant speed. 


The algorithm for avoidance collision has been developed by the B language 
on the PC98 and is used by being downloaded to the robot’s memory. 


The mobile object is a person. For the space in which the robot moves, 
typical simplified building passages have been conveniently constructed, 
using plywood, 10 m in thickness, as walls (Figures 9 to 11). 


Figures 9, 10, and 11 show collision avoidance being tested on, 
respectively, an I-shaped, A T-shaped, and a +-shaped passage. 


The robot confirms its present position on the passage and the presence of 
surrounding walls from local map information, discovers the mobile object 
and acts to avoid colliding with the oncoming mobile object. The local map 
is composed of a set of information comprising the passage and the 
intersection lying ahead. 


In this test, 2.4 m was always used as the passage width. 


The experiment in Figure 9 illustrates the case with a 0° collision angle, 
i.e., the mobile object approaches the robot from behind. The initial 
positions of the two are 1.2 m apart. The robot discovers the mobile object 
as it moves, then predicts collision, estimates the position of collision 
at 1.2 m from the initial position of the robot and avoids collision 
accordingly. 


The experiment in Figure 10 illustrates the case with a 90° collision angle. 
The collision point was 2.3 m from the initial position of the robot and 
1.9 m from the mobile object. 


The extension cables behind the robot comprise a charging 2p cable and an 


RS232C cable for collecting test data. Therefore, these cables do not 
impair the autonomy of the robot. 
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Figure 3. I-Shaped Passage Figure 18. | Shaped Passage 
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Figure 11 *- Shaped Passage 














8. Conclusion 


In this paper, we have proposed several methods to enable a locomotion rubot 
to avoid collision with an oncoming mobile object, and have described a 
basic test involving collision avoidance by an actual system using these 
methods. We first proposed collision possibilities, and then proposed how 
to generate collision avoidance paths. We discussed a method to avert 
collisions between the robots themselves, wing building passages as an 
example. We also studied, by simulation, the effectiveness of the collision 
avoidance methods proposed in this paper. Finally, we conducted a basic 
test on collision avoidance on a small experimental system using the 
educational robot HERO2000. Im this test, both the robot and a person, as 
rhs mobile object, moved by steps, and we showed examples of a collision 
ove \fance test in simplified building passages using an actual systen. 
Ts... .or the future include the realization of smooth collision avoidance 
actions of the robot, the realization of a collision avoidance robot using 
the sensor fusion of an ultrasonic system and a visual system, and the 
clarification of the case in which mobile objects and fixed objects coexist, 
the case in which several mobile objects exist, the case in which the mobile 
object itself acts to avoid collision and the problem of simultaneous 
collision avoidance. 
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Collision Avoidance in Locomotion Robotic Systens 
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[Article by Mamoru Saito, Osaka City Industrial Research Institute and 
Toshihiro Tsumura, University of Osaka Prefecture] 


[Text] 1. Introduction 


A vast amount of information and computation concerning all vehicles has 
been necessary to effectively implement operation control for vehicles used 
in systems, including the new transportation system and the factory unmanned 
conveyance system. In striving to achieve intelligent locomotion robots, 
the tendency in recent years has been to prefer using the flexible and 
extendable control system of the autonomous dispersion type as a control 
system for these locomotion robot systems. There, only the Limited 
information between nearby locomotion robots is used when determining 
control inputs. It is important, therefore, to maintain the consistency of 
the whole system by coordinating the locomotion robots while making the most 
of the independence of individual robots. 


This study concerns collision avoidance in the locomotion robot system as 
just one of the problems involved. 


A number of studies on collision avoidance have been conducted involving 
industrial robots in the past. In these studies, the method has consisted 
of first modeling work space according to visual information by the 
ultrasonic sensor, the CCD camera or some other means, and then evaluating 
the relative relationship to the obstacle. 


Proposals made in them include: 


(1) Method of defining the heuristic function and generating 
collision avoidance paths 

(2) Method of defining the potential function and avoiding collision 
while correcting the speed vector 


Many of the studies are cases handling the problem of robots as individuals, 
and none show a method effective for a dispersive system composed of several 
robots. 
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The authors previously proposed an algorithm to avert collision between 
locomotion robots using a heuristic method, and proved its effectiveness by 
simulation using an equivalent two-wheeled model for the robot dynamics. 


There, we stated the case of controlling the traveling azimuth, using the 
same speed for all robots, as a method of collision avoidance. However, in 
this article, we will report the case of controlling the speed, using the 
same traveling azimuth for all robots. 


The algorithm used here is basically the same as that previously proposed, 
and its procedure is: 


⸗ Each of the nearby robots gains information regarding the position and 
speed of the other by vision or communication. 


. Each evaluates the relative relationship and predicts collision. 


° If collision is predicted, a vector for suggested speed aimed at 
avoidance is derived accerding to the rule of coordination. 


° Avoidance is effected as real-time processing by causing the robots 
to follow it. 


2. Problem Setting 
As indicated in Figure 1, n-number of robots moving to their destinations 


by their autonomous guidance functions on a plane without obstacles is 
assumed as a model for the locomotion robot systes. 





Figure 1. Conceptual Diagram of Locomotion Robot System 
Each robot is supposed to have 
* Inherent domain 


This is a domain with a radius of r, which the robot occupies. It is 
determined according to the size and shape of the robot. 
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© Detecting domsin 


This is a domain with a radius of R, for recognizing the presence of the 
ovher robot (position, speed, etc.). It is determined according to the size 


of r, and the mcving speed. 

In this article, our discussion presupposes that all robots have the same 
R,. 

3. Predicting Collision 

Each robot evaluates the relative relationship between it and another robot 


which has entered its detecting domain from information regarding the 
position and speed of the other robot. 


Suppose that, in Figure 1, at time k, the positions of robots are x,(k) and 

x,(k) and their speeds are x,(k) and %,(k). Then, (k), the relative 
24 vector, and 5 (k), the relative ‘speed vector, of robot j, as viewed 
from robot i, are 


cz (a=) (h)- xi 0h) (1) 
Ry (e+ ky (h)- 2000) 


Assuming that the robots move at constant speeds, 1,,(t), the predicted 
distance function time t from now, is defined as follows: 


Litt) « P dy Cteny @ O° (2) 
At this time, the state between these robots can be determined by the 
differential value of 1,,(t) at the current time (t - 0). Namely, if the 


value is negative their distance decreases, and if it is positive the 
distance increases. 


Therefore, the conditions under which their collision (each invading the 
inherent domain of the other) is predicted are: 


Aty@ <6 (3) 


Chiglt) Deine Coyoryye (4) 


4. Derivation of Suggested Speed Vectors 
If robots i and j are in the state of possible collision ( tions in 
equations (3) and (4)), find the solutions for x, k) and 2 with 


their respective corrected speed vectors satisfying equation (5), to avoid 
the collision. 


(Lag (t) ) wie = Creeey)? (5) 


Considering robot i first, this can be obtained by replacing speed vector 
x,(k) with variable x,(j,k) in equation (5). 
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So, draw up 


By tt) © (hry) . Ry de Co, .05) 


[za i, ({,e)= Cay. mg) 
ry * Tt; +t, (6) 


(here p,, Pz. Yi, Ya, and AF known numbers from the preceding process) 


and substitute it for equat (5). 
At this time, equation (5) can be consolidated into the following quadratic 
equation: 

Fitco (7) 
Here, 


i [ene i 3 


e006 oe t,*- ts," +n") 
Py 8, “Pete ~(p, +, °Ry ty) 
i- [* |- — 


Therefore, equation (7) can be solved as 


oe ates 
fa, ¥, @2t-Ss Fe (8) 


The geometrical meaning of equation (8) is that it represents the two 
straight lines shown in Figure 2. This is a set of solutions for corrected 
speed vector x,(j,k) in which robot j avoids robot i relatively by right or 
Left and it cannot, as it is, be determined uniquely. 


So, set the following constraining condition for x,(j,k), considering the 
case in which a robot moved on a straigh” path toward its destination: 


Hy/K_q = Cy (9) 


Two solutions can be found from equations (8) and (9) (Figure 2). So, to 
use only one solution: 


(1) Avoidance by left 
(Solution xf(j,k) determined by /a,y, = /-a,y, and equation (9), 
is used as the suggested speed vector d,(j,k) 

(2) Use of the robot's limiting speed V,.. as the suggested speed 
vector if the solution of d,(j,k) exceeds V,.. is set as a rule 
of coordination between the robots. 
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Figure 4. Collision Avoidance Algoritha for Locomotion Robots 





The 


The above collision avoidance procedure is consolidated in Figure 4. 


same procedure is used for robot j. 





5. Simulation 
(1) Design of Control Systes 


Here, we shall design a method using LQ control as a robot follow up systes 
for the suggested speed vectors obtained by the foregoing procedure. 


First, 
as + cs = au (10) 


is assumed as the robot dynamics. s is the robet’s position and u is its 
control input. Ve also used 


e (coefficient of viscous friction) x = (mass) =< 0.2 
a (gain constant) x = (mass) = 0.3 


If state variable x = (s &)* and control input @ = G are used to formulate 
a speed control problem involving the robots, the following state equation 
expressed by discrete time can be derived from equation (10): 


pt @t-ao =) +8, 60) 


oe STOTT 


To enable the robot to follow target value r of the suggested speed, it is 
necessary to put 
e(t}er -7 c 
[-a-8a-n-800 


)-2 — 
Q (ade a (hel)-@ (12) 


——— 
— 1 (13) 


Since this extended system is attainable, i,.(k), the optisum input with 


ited * Ele cetee oy) 
* (14) 


as « minious, can be obtained as an evaluation function by the next 
equation: 
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It is known that feedback gains here, K and K,, can be given from the 
solution of the Riccati algebraic equation. 


In our simulation, therefore, we assume 0.1 to be the weight coefficient q 
and use 


K = [-4.4 x 10' - 1.61 x 10"], K, = 2.78 


computed on this basis. 
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Figure 5. Avoidance of Collision Between Two Robots 
(Case without speed limitations) 
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Avoidance of Collision Between Robots 
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(2) Results of Simulation 





Here, as basic collision avoidance, we studied a case using two robots 
(Figures 5 and 6) and one using four robots (Figure 7). 
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Figure 7. Collision Avoidarce Amcng Four Robots 
The simulation conditions are shown in Table 1. However, in the cases shown 
in Figure 7, 0.5 m/sec and 1 sec were uss4 for all robots as, 
respectively, the set speed | x,(0) | and limiting speed V,,.. 


Table 1. Simulation Conditions 
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Figure 5 concerns a case of collision avoidance in which the above-mentioned 
rule of coordination (2) was not set (i.e., without a robot limiting speed). 
It can be seen that the control systems of the robots cannot follow the 
suggested speed sufficiently, whereas, in a similar case involving rule of 
coordination (2) (Figure 6 (a-1)), collision is safely avoided. 


As can be presumed from the three cases shown in Figure 6, it is believed 
that collision avoidance between two robots is feasible as long as the 
moving paths of the robots do not overlap. 


Regarding the problem in which three or more robots are involved, this 
algorithm is applicable if, as indicated in Figure 8, the conditions under 
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which all robots can pass simsultaneously within the area enclosed by the 
crossing of their moving paths are satisfied. 


rebet i * 








Figure 8. Conditions of Moving Paths Making 
Collision Avoidance Possible 


Figure 7 is a case involving four robots. The robots stop if the above- 
mentioned conditions are not satisfied. 


4. Conclusion 


We have proposed an algorithm by which, in a dispersive system composed of 
more than one locomotion robot and based on the assumption that each robot 
is moving along a straight path toward its destination, the robots control 
speed according to the prediction of their mitual relative relationship, 
chereby avoiding collisions. 


We have shown here that avoiding collision according to different situations 
is possible by effecting speed control, with the speeds limited according 
to a rule of coordination between the robots. We have also confirmed the 
effectiveness of this algorithm by designing a robot followup system using 
LQ control measures and verifying it by simulation. Im the future we will 
also study designing locomotion robot operation and controlling their 
orbits. 
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Search Capability of Locomotion Robot in Unknown Environment 


43064062 Tokyo 4TH INTELLIGENT ROBOTS SYMPOSIUM PAPERS in Jspanese 
13/14 Jun 88 No 205 pp 91-96 


[Article by Junichi Eijima, University of Electrocommunications; Takashi 
Takeuchi, NIT; and Shinichi Aburada, Tsukuba University: “How To Search for 
Unknown Environments by Means of Locomotion Robot--Simulation Using Sensor 
Models" } 


[Text] 1. Introduction 


A locomotion robot normally moves with the help of an existing map but, if 
it could operate a location not on a map or in one with only an unreliable 
map, more useful activities could be expected of it. The purpose of this 
study is to establish a basic format for the operation of robots in such 
unknown places. 


Studies already announced with similar purposes include Hirose, et al.'s map 
producing visual system,’ Tazumi, et al.'s locomotion robot observational 
operation planning system,’ Ichikawa, et al.'s study concerning map 
revising,’ and Chatila, et al.'s system taking sensor system errors into 
consideration.‘ 


Here, let us consider the search for unknown environments to involve 
releasing a locomotion robot into a medium-size room in order to search the 
interior of the room and, after an appropriate period, causing it to prepare 
a map of the room and the obstacles in it. The robot basically prepares the 
map by observing the periphery with an environmental sensor, preparing and 
enlarging a map, forming a movement plan and repeating movement. 
Specifically, this involves the following problems: 1) determining its next 
destination and the attitude to be assumed there, 2) determining its path 
of movement, 3) determining the completion of its search, 4) movement 
planning and the form of expression to be used to determine the completion, 
and 5) preparing a map in which errors attending movement and errors of the 
sensor system are taken into account. 


The authors previously proposed a search method (corresponding to 1), 3) and 
4) above) using two types of map information--grid expression and vector 
expression--and indicated that, in an ideal case without sensor errors, it 
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would be possible for the robot to search, sensing unknown environments on 
a real-time basis.° 


In this study, to cope with accidental errors occurring to internal and 
external sensor systems in the real world, we have corrected errors of robot 
positions by fusing errors in sensor systems and have extended our 
previously proposed method so that more reliable maps can be composed We 
have also evaluated the effectiveness and realizability of this method by 
simulation using models of sensors in which errors occur. 


2. Problem Setting 


Let us first examine the unknown environment conditions to be searched by 
a locomotion robot and the modeling of internal and external sensors 
containing realistic errors. We will assume a wheel-shaped locomotion robot 
with a range finder as an external sensor, and as an internal sensor, a 
travel recorder to estimate the current position of the robot from the per- 
unit-time rotation of the driving wheel. 


2.1. Environmental Conditions 
We have studied the following environments: 


(1) In a building with a nearly level floor and of a certain size (about 
20 m*), the robot can move freely if no obstacles exist. 


(2) There is more than one room in the environment and the rooms contain 
furniture and other obstacles, but no mobile objects are present except for 
the robot. 


(3) The shape of the silhouette of an obstacle projected on the floor can 
be approximated to a polygon with a side of at least 20 cn. 


(4) The shape of the locomotion robot can be approximated by a circle with 
radius r, (= 40 cm). 


2.2 Model of Internal Sensor 


In the robot "Yamabiko No 9," which the authors developed, accidental errors 
occurred when tracking (dead-reckoning) the position of the robot by the 
internal sensor were within 1-2 percent of the moving distance for position 
and t1° for attitude. Therefore, in the simulation model of an internal 
sensor with errors, the robot positional error must be expressed by a two- 
dimensional normal distribution with a standard deviation of 2 percent of 
the moving distance. As for the robot attitudinal error, it must be 
absorbed by this positional error, as well as by the errors of the external 
sensor which will be described next. 


2.3 Model of External Sensor 


The robot must be able to measure its distance to an obstacle located within 
a certain distance, from r,,, (= 50 cm) to r,,, (= 400 cm), in any direction, 
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by tk: external sensor when it remains at a certain position in the 
environment. By processing the measured distance data, one can detect the 
polygonal domain formed by projecting onto the floor the space in which the 
robot can move freely within the range of observation (free space). It is 
assumed that, in reality, a polygon can be obtained which is composed of 
defined boundaries and edges resulting from the inability to observe due to 
being behind obstacles, etc., or being beyond the range of observation (free 
space). It is assumed that, in reality, a polygon can be obtained which is 
composed of defined boundaries and edges resulting from the inability to 
observe due to being behind obstacles, etc., or being beyond the range of 
observation (provisional boundaries) (Figure 1). Such a ranger finder can 
be realized by, for example, turning a TV camera +180°. 





lid line: 
Defined boundary 
Dotted line: 
Previsional boundary 


Figure 1. Measuring Range of Range Sensor (External Sensor) 


A range finder incorporating errors has been modeled as follows (Figure 2): 
First, a normal random number with a standard deviation of 1 degree is 
assigned to each apex of the polygon which exhibits ideal, errorless free 
space and is obtained from the environmental data given in advance in the 
line-of-sight direction of the apex (Figure 2(2)). Then, a normal random 
number with a standard deviation of 6 cm is given in the depth direction of 
the camera's line of sight to points, about 0.2 degree apart, on the sides 
of the defined boundary of this polygon (Figure 2(3)). Each point is 
regarded as a mass point, its 0~2-order moment and principal axis of inertia 
are obtained, and its inclination is used for the defined boundary (Figure 
2(4)). However, a defined boundary with less than 5 degrees as the angle 
difference, estimated on the basis of the beginning and end points is 
regarded as a provisional boundary since its position cannot be obtained 
with high precision, even though it has been detected in the picture as an 


edge. 


The above values of standard deviation, etc., were determined from our test 
experience using a visual sensor with a CCD camera. 


3. Method of Map Expression 


When a robot operates in unknown environments, no maps are available, so it 
must prepare one for itself. In this case, the map must be composed on a 
real-time basis from definite observed data. Therefore, it is advisable 
that an expression be used that is more specific, material and succinct. 
Here, two types of maps with two-dimensional expressions are used together. 
These maps are referred to as vector and grid maps. 
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Figure 2. Observation Errors 
3.1 Vector Map 


The vector map describes the shapes of rooms and obstacles as an aggregation 
of polygons, and comprises the immediate purpose of searching. Here, each 
side of a polygon is oriented so that the free space to the right can be 
seen. One room or obstacle is expressed as a chain of several of these 
oriented segments (chain vector). The individual oriented segments that 
form the chain vector are called defined vectors. The defined boundary 
obtained when the robot observes from a certain position is deemed the 
result of detection of some of the defined vectors (this defined boundary 
is called a partial segment), i.e., a defined vector is made by uniting more 
than one partial segment. 


3.2 Grid Map 


The grid map divides search environments into grids and indicates whether 
each division is a free space, permitting locomotion. Grid maps are used 
indirectly when planning operations or determining the completion of a 
search. In this test, each grid was a 20 cm square. The divisions of the 
grid map are classified as follows (Figure 3): 


(1) Unknown division: Division yet to be observed 
(2) Free division: Division containing no objects and permitting 
free locomotion 
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(3) Boundary division: Division crossed by a defined boundary 
(4) Occupied division: Division in which locomotion and observation 
are impossible 





Figure 3. Classification of Divisions 


An unknown division is reclassified as either a free division, a boundary 
division or an occupied dot elimination as searching progresses. 


4. Searching Method 


We shall now discuss the basic concept of the searching method, the method 
to prepare and extend a more accurate environmental map from erroneous 
sensor data and the method to correct deviation in the position of the 
robot, taking advantage of information from the environmental map prepared 
by the robot. 


4.1 Basic Concept 


Previously, we proposed a love-at-first-glace method as a way of planning 
the operation of a locomotion robot which would enable the efficient 


searching of an unknown environment to be accomplished. 


In this method, the locomotion robot released in an unknown domain first 
observes the periphery by an environmental sensor, notes the longest of the 
chain vectors in the local vector map, and selects, as the next locomotion 
point, a position from which the end point and its vicinity can be observed 
so that the end point may be gradually extended. The robot observes fros 
varied positions and uses the data gained to extend the vector and grid 
maps. In the vector map, new chain vectors are added and chain vectors 
already detected are extended. In the grid map, on the other hand, the 
unknown division is reclassified into a free division or a boundary 
division. When extending the map, errors in sensor data are taken into 
consideration. This will be described in the next section. 


When searching progresses and the chain vector being pursued closes to forms 
a polygon, the unknown division on the left side of the chain vector is 
reclassified into an occupied division. Then, the same principle of 
locomotion is applied to all chain vectors yet to be closed. If there are 
unknown divisions on the grid map when no chain vectors remain to be closed, 
the point from which the nearest unknown division can be seen is selected 
as the next locomotion point. 


When all chain vectors detected are closed and no unknown divisions remain 
on the grid map, searching is completed and the environmental map is ready. 
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4.2 Extending of Maps 
We will now discuss the extending of the vector and grid maps. 
4.2.1 Data Composition in Vector Map 


In the vector map, all partial segment data (local vector map) obtained on 
each occasion of observation are preserved, and the aggregation of component 
partial segments is coordinated to each defined vector. Therefore, 
elaborate correction of the vector map becomes possible by enabling the data 
medium on partial segments observed at each corrected position of the robot 
to correct defined vectors containing these data and chain vectors each time 
the position of the robot is corrected. 


The vector map can be obtained by first computing each defined vector from 
the partial segment and then causing the apices of the connected defined 
vectors in the chain vectors to agree, thereby guaranteeing their 
connnectivity. 


When partial segments are added, the moment and inclination of defined 
vectors are computed again, using the moment of the partiei segments 
composing them. Therefore, the positional information of partial segments 
must include not only information on their beginning and end points and 
inclination, but also information on their 0-2-order moment and the 
positional error of their beginning and end points (= predicted positional 
error of robot + observation error) and information to show whether the 
beginning and end points are apices denoting objects, etc., or whether they 
are mere terminal points. As for each moment of a defined vector, the 
weighted mean by the inverse of the positional error (standard deviation) 
of the robot at the time of observation is used for each moment of each 
partial segment composing the vector. If, for instance, three partial 
segments: 1,, 1,, and 1,, are united as a defined vector, each moment M,, 
(i,j = 0-2) is computed as follows: 


. af. ,/@,002,.,/@2%8).,/@3 
‘ e 
“War t Veet Ves (Equation 1) 





Here, ml,,, m2,,, m3,, (i,j «= 0-2) comprise the moment of each segment around 
the origin in coordinate system common to these segments, and ¢,, o*, and 
o* are the positional errors (standard deviation) of the robot at the time 
of observation of each segment. 


The beginning point (end point) of a defined vector is obtai;ned as follows: 


(1) If the partial segment contains beginning points (end points) denoting 
apices, use the weighted mean by the inverse of the square (dispersion) of 
the positional error for these points (probable maximum value). For the 
positional error at that time, use the smallest sf the positional errors at 
the beginning (end) points of the partial sagne nts expressing apices. 
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(2) If this is not the case, use the point farthest from the center of 
gravity of the defined vector. The positional error at that point is used 
as the positional error of this defined vector. 


Finally, for two defined vectors connected in a chain vector, the weighted 
mean by the inverse of the square of positional errors at the end point of 
one and the beginning point of the other is used as their intersection, 


thereby guaranteeing their connectivity. 


4.2.2 Extending Vector Map 


The method used to add information from the 
our. recent observation, to the vector map prepared consolidating the 
results of our past observations, can be divided into the process uniting 
the defined vectors in the vector map and the partial segments on the local 
vector map and the process connecting thea. 


The conditions for the overlapping of a defined vector and a partial segment 
are as follows (Figure 4): 


Condition @ sisi. 4. I. 
Figure 4. Conditions for Uniting Segments 


(1) The angle difference between the two segments is less than a certain 
threshold value, THl. 


(2) A perpendicular from any of the four beginning and end points of the 
two segments can be drawn from either segment to the other, and the length 
of this perpendicular is less than threshoid value TH2. 
(In the test, we used TH] = 30.0 (deg), TH2 = 50 [cm).) 


The conditions for connecting the beginning (end) point of a defined vector 
and the end (beginning) point of a partial segment are as follows: 


(1) Both points are detected as apices of obstacles, etc. 


(2) The distance between the two points is less than certain constant 
multiplied by the value C of the larger of the positional errors at these 
two points. 
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A positional error is a standard deviation in normal distribution. 
Therefore, if C = 1, 2, and 3, the two points, if they actually are 
equivalent, can be connected by the probabilities of, respectively, 
approximate 68, 95, and 100 percent. However, if C is too large, it follows 
that two points that, in reality, are not equivalent are connected. 
Therefore, in this case we used C <~ 2.0. 


4.2.3 Extending Grid Mep 


At the beginning of a search, all divisions of the grid map are unknown 
divisions. In each observation, appropriate unknown divisioas in the 
vicinity are changed into free divisions or boundary divisions (divisions 
containing chain vectors). In addition, when the chain vectors close on the 
vector map, the unknown divisions contained in the closed domain surrounded 
by these vectors become occupied divisions. 


In our recent test, we used divisions that were as large as 20 cn’. 
Therefore, it is believed that errors in the internal and external sensor 
systems of or about the order state in Chapter 2 can be absorbed almost 


completely. 
4.3 Correction of Robot Position 


During searching, deviations in the current position of the locomotion robot 
are detected and,if necessary, corrected, using vector maps prepared 
previously. This is done by noting the apices of walls and obstacles as a 
characteristic of an environment, and is divided into correcting the current 
position of the robot and correcting past positions. 


4.3.1 Correction of Robot’s Current Position 


Using local vector maps obtained from our recent observations and vector 
maps consolidating observations from the first to the last, we explored how 
points detected as the apices of walls and obstacles became sutually 
coordinated. The conditions for judging that two apices agree are as 
follows: 


(1) The angle difference of the two edges composing each apex is less than 
THRE TH. However, this does not apply if there are no edges composing the 


apex. 


(2) Apex errors in the vector map are smaller than those in the local 
vector map, and the distance between apices is less than a certain constant 
multiplied by the value C of the apex error in the local vector map (in 
4.2.2, we used C = 2). 


If there is a pair of corresponding (agreeing) apices, find a parallel 
locomotion vector (present position correcting vector) that makes the 


coordination points in the local vector map agree completely, and correct 
the position of the robot according to this correction vector. Substitute 
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Figure 5. Correction of Robot’s Current Position 
4.3.2 Correction of Past Position 


The balance after subtracting the observed error from the apex positional 
error in the vector map, used to correct the robot's current position, is 
shown as loca-err-min. The robot's position and its error 
corrected for ail observation points, from the current 
retroactivnly to point Q, with the robot’s positional error becoming less 
than loco-err-min for the first time. 


1 
a 
~ 
5 


Correction vectors for all observation points are obtained as follows: For 
each observation from Q to one point before the current positicn, the asount 
of movement from Q to that point, using 1 as the amount of movement from Q 
to the current position and weighted to the size of the correction vector 
at the current position, is used as the correction vector at that point 


(Figure 6). 


For the predicted positional error at each observation point, we take « 
smaller error of the two, either the positional error prior to the 
correction or that obtained by inverse operation from the current positional 
error, on the assumption that, after the correction, the robot will have 
moved from its current position to a previous one (Figure 7). 


5. Test Results end Discussion 


We shall now discuss the results obtained when we implemented the above- 
mentioned searching method by simulating error-containing internal and 
external sectors on the computer. We used the C language for our progres 
and personal computer PC98O1VX for the test. 


We applied accidental errors, as described in Chapter 2, to each sensor. 
However, to cut computing time as such as possible within the limits of 
reality, an interval of 1.0 degrees was used for the error applied in the 
direction of the line-of-sight depth of the camera. 
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Figure 6. Correction of Past Position 
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Figure 7. Correction of Previous Positional Error 


example of the results of this simulation is shown in Figure 8. Our 
ing and determination of points of view took only about 10-20 seconds 
per observation point. Therefore, this searching method generally satisfies 
the real-time requirement necessary for the robot to prepare a map as it 
moves slowly. It was aleo confirmed that, if this searching method is used, 
an unknown environment can be thoroughly searched by repeating observation 
and locomotion 20-30 times, at the most. 


Figure 6 indicates that the saximum value of the predicted positional error 
of the robot is less than 1 percent of 95 =, the total distance of its 
locomotion in all environments, and the deviation from the true position of 
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Figure 8. Example of Test Results 


the robot at the observation point is less than 0.25 percent of the total 
locomotion distance in terms of the mean value and less than 0.5 percent in 
terme of the maximum value. This means that the method for correcting robot 
positions, using some environmental information on the already explored 
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domain, worked effectively since we assumed an error equivalent to 2 percent 
of the distance traveled was applied to the robot’s locomotion. 


As for apex information in the vector map completed, deviation from the 
actual position is about 20 cm, roughly the size of a division in the grid 
map, in terms of mean value, and less than 50 cm in terms of maximum value. 
Therefore, our method generally satisfies the precision necessary for the 
robot to grasp this environment. 


However, this method brings up the following problems: 


(1) In an environment where obstacles are so close to each other that the 
robot cannot pass safely between them, it is not always possible to move the 
robot to an observation position to which a chain vector can be extended. 
To cope with this situation, it is necessary to add a process enabling the 
robot to recognize several objects close together as an integrated whole, 
and to improve map expression so that the map can show incomplete shapes. 


(2) If locomotion errors accumulate and the positional errors of the apices 
become large, such situations as extending a vector map by coordinating 
apices that must not be connected or making wrong apices agree and 
erroneously correcting robot positions can occur. Our recent simulation 
test has confirmed that no such problems occur if obstacles with the 
smallest side of approximately 100 cm are involved and searching is 
completed more or less properly. It is believed, therefore, that the search 
to make maps with improved precision for increasingly complex environments 
can be implemented if the robot, while pursuing a chain vector, goes out of 
its way to accurately observe a possible nearby apex, thereby suppressing 
the accumulation of locomotion errors as much as possible. 


6. Conclusion 


In this paper, we have proposed a method of map expression suitable for 
searching unknown indoor space using a locomotion robot with a range sensor, 
and a method of search planning using this map information. We have assumed 
that the internal and external sensor systems contain accidental errors that 
are sufficiently realistic, and have discussed a method to compose a more 
accurate map by consolidating uncertain sensor data and a way to correct the 
position of the robot, if necessary, by taking advantage of the 
characteristics of the environment’s interior. 


In addition, by preparing sensor simulation models containing errors, we 
have implemented the subject method and confirmed that an unknown 
environment can be searched with some efficiency, while satisfying the real- 
time requirement necessary for the robot to make a map as it moves slowly. 
We have also confirmed that the robot's accumulated errors can be held to 
within a certain scope, and that an environmental map can be composed which 
is believed to be precise enough for the robot to generally grasp the size 
and shapes of the room and the obstacles. 
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Map Expression, Path Planning for Locomotion Robots 
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[Article by Yoshiaki Hirotani, graduate school, Kyushu University; and 
Shinichi Aburada, Tsukuba University] 


{Text} 1. : Introduction 


For a locomotion robot, moving autonomously through a given environment is 
thought to be a basic function. Studies to realize this have been made in 
many circles,*~® with some of the results already having become practical. 
However, most of the previous studies presupposed the setting of landmarks 
in the robots’ locomotion environments with a view to achieving practical 
use, or consisted mainly of theoretical research on the problem of path 
planning for robots. Therefore, many developmental problems remain to be 
solved to establish methods necessary to enable the robot to move 
autonomously through an actual environment by its intelligent locomotional 
function. 


The authors’ research group has been engaged in research to provide the 
small autonomous robot, Yamabiko, which travels through an indoor 
environment, with an autonomous locomotional function. This autonomous 


locomotion system is composed of the following parts: 


(1) The rebot contains a world map as the environmental map for the real 
world in which it lives. It always knows its position on the map. 


(2) When it is given its destination, the robot determines its path fron 
its current location to the destination, using the world map, and produces 
a path map showing the path and the environment along the path. 


(3) The robot moves to its destination as it confirms its position in the 
environment and its safety, using its sensor system and traveling system on 
a real-time basis. 


We have already reexamined and tested our methods of map expression and path 
mapping,’ as well as our method to control traveling in the real 
environment.’ However, in our past map expression and path mapping, the 
environment was limited to the interior of a room or a set of rooms and a 
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building corridor. Therefore, the problem was that it was not realistic to 
extend robot locomotion environments beyond certain limits. 


Therefore, we recently devised a method to express map information for 
indoor environments and a way to efficiently determine a path, using this 
method, in order to realize the heuristic function of moving autonomously 
through a large indoor environment covering a number of buildings. These 
methods are mainly characterized by taking advantage of the structure of the 
locomotion environments, conceiving them hierarchically and using this 
hierarchy in map expression and path planning, in addition to using this for 
map expression in an environment such as a corridor, which has a standard 
passage method. 


2. Composition of Autonomous Locomotion Systen 


In designing the composition of this study’s autonomous robot locomotion 
system, it is an important condition that the robot be able to actually 
travel the real environment that the robot be able to actually travel the 
real environment using its sensors and traveling function. We currently use 
an ultrasonic range finder as a sensor to recognize environments since, at 
the present technological level, it is difficult to find a much better 
environmental sensor that can be carried by a robot and used on a real-time 
basis. It is, therefore, assumed, in this autonomous locomotion systen, 
that the robot has an ultrasonic range sensor or the equivalent and that its 
environment is a two-dimensional world in which the walls are almost always 
flat and exist, as a principle, at right angles or are parallel. It is also 
assumed that, as a principle, the robot travels parallel to the walls in the 
environment. This is a rather strict condition, but the actual environment 
in which we are conducting the test meets this requirement. 
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Figure 1. Composition of Autonomous Locomotion System 


The composition of the autonomous locomotion system presupposing work under 
environments of this type is shown in Figure 1. This system is generally 
composed of three portions. The first is the portion located outside the 
robot, which prepares environmental maps. Real time is not required here. 
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The second portion is located in the robot and plans paths from information 
received from the operator concerning the current location and the 
destination. Here, quasi-real-time processing may be required if several 
seconds are available for thinking before the robot begins to travel. The 
third portion handles actual traveling. Here, the robot must incorporate 
sensor information on a real-time basis as it travels in the actual 
environment and confirm traveling and safety according to the planned path. 


In the first portion, a world map is prepared following a human's survey of 
the robot’s locomotion environment. World maps are of two types: external 
expression and internal expression. [External expression is a textual 
description easy for a human to understand, while internal expression is 
world map information turned into an expression suitable for later 
processing. 


In order for a robot to actually travel, the operator must first give the 
robot its destination. The robot determines its path and generates a route 
map by retrieving the world map from its current location and given 
destination. This process is called route map generation (RMG). The route 
map includes map information which serves as a guide from the current 
location to the destination, and is composed of route information to show 
straight travel or right/left turns, etc., environmental information to show 
the scenery along the route, and place name information necessary for the 
robot to locate its present position on the world map as it travels. 


In this article, we discuss our newly-devised formulas concerning the first 
portion, world map expression, and the second portion, route planning and 
route map generation. 


3. Map Expression for Large Indoor Environments 
3.1 Hierarchical Map Expression Based on Building Structures 


We envision the interiors of several connected buildings as the locomotion 
environment of a robot. Here, the third group of school buildings at 
Tsukuba University is shown in Figure 2 as an example. A robot environment 
like this one can be taken hierarchically as the world--the building, the 
block--which consists of a corridor in the building and the rooms connected 
to it--the corridor and the rooms. In addition, there are bridges between 
the buildings, and corridor intersections between the corridor blocks. This 
is shown in Figure 3. It is necessary for the robot to use a corridor to 
move from one roon to another and to use a bridge to move from one building 
to another. Therefore, in planning a locomotion route in these buildings, 
it is efficient to divide the route plan, by level, into general and local 
plans. For this purpose, it is necessary to express the map hierarchically. 
By this hierarchical description, information on inclusive relationships 
involving, for example, which corridor is in which building, can be tacitly 
expressed, and this inclusive relationship can be passed down from the 
building to the corridor block and eventually to the room. 
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Figure 2. Third Group of Buildings, Tsukuba University 








Figure 3. Hierarchical Structure of Locomotion Environment 
3.2 Description of General Graphic Information on Environments 


Information on the connection of buildings and the intervening bridge, as 
well as that on the connection of corridors within each building, can be 
expressed as graphic structures. In addition, the cost of the robot's 
locomotion between bridges or intersections can be expressed by assigning 
a value to each edge in the graph. If the map contains detailed information 
on all buildings, graphic information can be generated. However, to select 
a route efficiently, it is preferable that this general graphic information 
be prepared in advance. Therefore, we regard the world map as redundant and 
express graphic information on spaces between buildings and between 
corridors in advance and separately from detailed information on the 
buildings and corridors themselves. 


3.3 Expression Conforming to Route Map 


In planning robot routes, the general environment is divided into the 
following two types: 
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(1) World of the room or the opening 


Generally, this consists of a large free space and the obstacles within it. 
The route used by the robot is determined by the departure point and the 
destination. It is difficult to devise a standard route. 


(2) World of the corridor 


This is generally a world that is long and narrow and is often used as a 
thoroughfare. It contains a standard passage and, normally, the robot can 
use it. 


The world within the building is thought of as a mixture of these two types 
of worlds and, when preparing a map, each area characteristically can be 
divided, in advance, either into rooms or corridors. 


To express a map for a world of the room or the opening in (1), it is 
generally advisable to describe the shape of the expanse of space and the 
objects within it.‘ On the other hand, the route map environment information 
to Le output as a result of route planning is information on the environment 
along the passage. Therefore, in the case of (2) in which the environment 
contains a corridor or some other definite standard passage, we classified 
the areas into the above-mentioned two worlds by describing environmental 
information along this route in advance, employed different environmental 
expression methods for each world and, for the “world of the corridor," used 
a method of expression conforming to the route map. 


3.4 Definition of External Expression of Map 


We defined our method of expression for the interiors of buildings according 
to the above concept. However, we only defined the position of the room 
(door) as a component of the corridor, leaving the interior of the room to 
be expressed according to our old formula. This method of expression is 
generally composed of a description of environmental information and one of 
information on the graphic structure of the locomotion environment, with 
these each being expressed hierarchically. Figure 4 shows part of the 
definition of the map expression format. Therefore, the external expression 
of a map is described by Equation S. Figure 5 shows an example of 
expression for some of the buildings in Figure 2. 


In our previous studies, we used frame expression, a method of knowledge 
expression, for our environmental maps. However, in our new method of 
expression, we did not employ frame expression due to the following: 


(1) The map is composed solely of declaratory knowledge and no procedural 
knowledge exists in it. Therefore, it cannot exploit the advantages of 
frame expression. 


(2) Each object to be expressed in the map has an inherent structure 


involving space, dots, etc., and object abstraction cannot be effective in 
planning robot paths. 
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<Map proper>::=-(<bridge list><building list><path list>) 

<Building>: :=<(<building name><building proper>) 

<Bridge>: :=(<bridge name>(<coordinate>) ) 

<Path>; :=(<bridge name 1><bridge name 2><building name> 

<cost><path proper>) 
<Building proper>: :=((<coordinate system>)(<intersection list>) 
(<corridor list><corridor net list>)) 
<Intersectionm: :=—<intersection name><attribute> 
<Intersection attribute>: :=BRIDGE<bridge name>: JUNC]: JUNC2: 
JUNC3 : JUNC4 
<Point>: :=(<point name><coordinate>) 
<Corridor net>::=-(<intersection name 1><intersection name 2> 
<corridor name><cost>) 
<Corridor proper>::=((<coordinate system>)(<corridor shape>) 
(<direction>)<length>(<door list>)(<room 
list>)(<point list>)) 
<Corridor shape): :—<beginning wall information><middle wall 
information><end well information 

<Beginning wall information, end wall informatiom: :- 

((<front wall information><distance>)(<rear wall 
information>-<distance>)<left wall><right wall>) 
Wall: :=(<attribute>XD><X2X<¥Y) 
Wall attribute>: :=<FLAT: UNDEF: DOOR: CORR: CIRCL 


Figure 4. Part of Definition of Map Expression Format 
3.5 Internal Expression 


To mount a map on a locomotion robot and execute path planning, etc., 
accordingly, it is necessary to make effective use of limited computation 
resources. Therefore, in this system we used the C language to prepare our 
path planning programs and changed map information, in advance, into 
internal expression using an expression method suitable for processing. 
Specifically, we used internal expression involving the structure of the C 
language. We produced a map translator as a program to convert the external 
expression of the world map into its internal expression. 


4. Path Planning 

4.1 Path Planning Method 

(1) Path Planning Using Map Hierarchy 

Using the above-mentioned map, the locomotion environment of a robot is 
expressed hierarchically. Therefore, a path can be selected for each rank, 
from an upper rank to a lower rank, and the process of path selection can 
be implemented efficiently. Figure 6 shows hierarchical path planning. 
Path planning can be achieved by searching for a path which the robot 


follows, at minimal cost, using a map. Namely, one has only to search for 
a locomotion environment as a graphic structure at each rank of the 


144 














(DAI3_3(((BR1(9100 13100))(BR2(10700 7900)) ++++) 
((BILE((1200 2300 0) 
((JE1 BRIDGE BR6)(JE2 JUNC3)(JE3 JUNC1)(JE4 BRIDGE BRS) 
) 
((CE1((88 103 0) 
(( (CORR 1000)(CORR -807) 
(CORR 0 111 1000)(FLAT 0 109 -126) 
) 
((FLAT 111 187 95)(FLAT 0 109 -126) 
(UNDEF 187 256 200)(CIRCL 109 256 -66) 


) 
((CORR 1000)(CORR -1000) 
(FLAT 3931 4095 -120)(FLAT 3931 4095 114) 
) 
(JE2 JE1) 4095 
((DEO011((523 123)188)) +++) 
((E301(DEO11 DE102)) «+++) 
Q 
) 
) 
((JE2 JE1 CEl 4095)(J32 JE4 CE2 1606) 
(JE2 JE3 CE3 807) 
) 
) 
) 


((BR2 BR3 BILA (CA2 CA1O)) «+++) 


Figure 5. Example of Map Expression 














(Poth in interior of rece) 


Figure 6. Method of Path Planning 
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hierarchical structure. Here, we gave the cost as the weighted sum of the 
distance traveled and the number of right/left turns. 


(2) Path Selection of Building Level 


If the departure point and the destination are in different buildings, 


select a building to be passed through as a general path. Here, two things 
are necessary. The first is generating a building graph, and the second is 
searching on that graph. As for the building graph, information involving 
the state of connection between the building and the bridge is shown on the 
map in advance but, when the departure point and the destination are given, 
the graph to be searched must be obtained by generating a new node and an 
edge, including cost, and adding them to the graph. Figure 7 shows the 
building graph to be generated if, for instance, the departure point in 
Figure 2 is in Building E and the destination is in Building B. 


o Betted line: edge 
requiring cost 
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Figure 7. Growth of Building Graph 


Here, the cost of the edge to be newly generated was estimated from the 
relationship between the position of the departure point or the destination 
and that of the bridge. This cost can be determined more accurately after 
selecting the path in the building but, in practice, a cost determined with 
a certain degree of accuracy is believed to be sufficient. 


(3) Path Selection at Corridor Level 


Generate a corridor graph and search it, as was done in path selection at 
the building level. However, the generation and searching of this corridor 
graph is necessary only for the buildings in which the departure point and 
the destination are present. For the intermediate buildings to be used only 
for thoroughfare purposes, use the map description of the standard path 
between the bridges at the entrance and the exit. 


4.2 Route Map Generator 
In the autonomous locomotion system, the program to plan paths and generate 


route maps is called the route map generator (RMG). Figure 8 shows 
schematically the RMC processing procedure. 
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Figure 8. RMG Processing 
(1) Designation of Departure Point and Destination 


The departure point and the destination are designated by position and the 
direction of the robot. The position is designated by a coordinate value 
for the building or the corridor, but it is also possible to designate it 
using an expression which is intelligible to people, e«.g., a point name 
defined in the map in advance and a door name for each roca. 


(2) Recognition of Departure Point and Destination 


In path planning, the buildings, corridors or rooms where the given 
departure point and destination exist are determined by map retrieval. 


(3) Path Planning 


The path to be followed by the robot is selected by the method stated in 
4.1. 


(4) Generation of Route Map 


to always be aware of its current position on the 
of information are generated using parameters obtained from the 

of ranks during path planning and by referring to the world map. The route 
map can be obtained by arranging thea, in order, according to the path plan. 
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In these methods, we assume that the environmental map has been prepared by 
man for the robot, rather than prepared by the robot itself. Structurized 
maps convenient for the robot's path planning can be produced by using these 
methods. However, detailed environmental maps must be provided in sdvance 
to enable the robot to travel within actual environments, while continually 
referring to its sensor information, and an environmental map and the work 
it necessitates are vast, indeed. Therefore, it will be necessary to 
research a formula to produce maps through san/robot cooperation by, for 
instance, using the robot as a tool for map making and supplying it with 
environmental information through teaching. 
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[Article by Tomofumi Morita, Youichi Maruya, Hiroyuki Takahashi, and Akihiro 
Okuno, Mazda Motor Corporation) 


(Text) 1. Introduction 


Research involving the introduction of locomotive objects using visual 
sensation is being conducted. Locomotive objects move in various stages. 
Por example, one stage is that in which mobile objects can be easily 
directed by human beings to recognize something, while another is that in 
which it is difficult for objects not operated by humans to do so. 


We think that one can regard environments employing locomotive objects as 


either having already been prepared or having the potential to be arranged 
to enable these objects to be applied to industrial fields. 


An experimental vehicle, which is an intelligent locomotive robot intended 
for application as an eutonomous land vehicle (1) to move within factory 
sites and buildings has been developed as basic research to introduce 
locomotive objects to such environments (Figure 1.1 [not reproduced)). 


People should organize environments in accordance with the complexity 


are studied, in many cases, such items as roads 
good enough repair for humans and vehicles to pass through. 
range and direction of the roads and paths through which humans and vehicles 
can pass have been determined. If such roads and paths can be used without 
any changes, the cost of preparing the environment can be reduced. 

lo 


E 
25 
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We have minimized the environmental preparation by exp 
environments, and have evaluated the feasibility of using real tine 


and 
difficulty of low-level recognition of the outsider using images, because 
feasibility will become important in these environments. 








2. Purpose of Development of Autonomous Traveling Experimental Vehicle and 
Environment in Which This Vehicle Moves 


We have conducted research on an autonomous traveling experimental vehicle. 
This vehicle currently moves inside buildings. 


Various indoor environments can be studied, e.g., environments such as room 
interiors in which the degree of freedom of movement is high while the 
movement is complex, and corridors in which the degree of freedom of 
movement is low and the direction and range over which humans and vehicles 
can pass have been predetermined. 


The autonomous traveling experimental vehicle can pass through such 
corridors as is, but when it moves inside rooms, the degree of freedom of 
movement must be restricted, and the rooms’ contents must be arranged. 


Environments which we have studied up to now include corridors and room 
interiors. It has become possible for the autonomous traveling experimental 
vehicle to travel on paths, because we have attached cloth tapes to the end 
of these paths, and have provided them as continuous targets within the 
rooms. 


One can regard the end of a corridor as a continuous target, because it is 
not necessary to specially arrange most corridors. However, in the case of 
complex environments, e.g., when corridors cross each other or when the 
width of the corridor changes along the way, the exterior of these corridors 
must be highly recognizable for their structure to be grasped. The 
autonomous traveling experimental vehicle which we have developed is a 
system to evaluate the feasibility of real time and the inflexibility of 
external recognition. We plan to raise the current level of the system to 
the practical level, and to solve future problems by using a sophisticated 
system in respect to hardware. Currently, we have decided to use diagrams 
so that the autonomous traveling experimental vehicle can readily comprehend 
the above-mentioned environments. In this case, these diagrams express the 
physical constitution of these environments abstractly. Compared with 
robots, to which the speed, control angle, etc., are indicated precisely, 
the above-mentioned vehicle is more flexible when traveling. In addition, 
it is mot necessary to show, even abstractly, environments, such as paths, 
on which the autonomous traveling experimental vehicle cannot travel. It 
is permissible to show environments assumed to require the vehicle to take 
actions in response to human instructions. The frequency diagram 
installations abstractly expressing such environments should depend on the 
degree of change of the environments, the accuracy of the internal sensors, 
and the system's capacity. However, it is not necessary to continuously 
install diagrams, and these diagrams can be regarded as showing divergent 
targets. 


Figure 2.1 shows an example of a diagram we devised. In this case, the 
vertices of the polygon show the direction of the corridor’s branches. 
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Figure 2.1 Diagram Formed by Abstracting an Environment 


As mentioned previously, environments are organized by determining targets. 
In addition, such environments as room interiors and corridors through 
which the above vehicle travels possess the following features. 


(1) Vinyl sheets, usually called "P tile," are laid on the floor. The P 
tile is colored uniformly, and may be striped with thin lines of a different 
color than that of the tile as patterns. The surface of the P tile is 
lustrous since it is waxec. Accordingly, it may reflect the surroundings. 


The seam between the tiles is slightly conspicuous. 


(2) Light streams in through fluorescent ceiling lamps or windows. When 
the sun’s direct rays, etc., greatly affect the brightness in the 


photographing range, photographs are not taken in this experiment. 


(3) The color of the cloth tapes must be readily distinguishable from that 
of the floors. Appropriate cloth tapes are selected and used to determine 
targets. 


(4) Also, flush plug receptacles are installed as foreign matter under the 
floor. 


Therefore, even when the range and direction has been determined by 
arranging the environment so that the above vehicle can travel on corridors 
and inside rooms, it is necessary to establish the real time and 
inflexibility of the simple image processing involved in detecting targets, 
because environments other than the above-mentioned ones have not been 
organized. Simple image processing is a basic technology which will 
inevitably become necessary in the future when advanced external recognition 
is realized so that such vehicles can function even in rough environments. 
We have regarded this simple image processing technology as a low-level 
image processing one, and have developed it as a visual system for use by 
indoor autonomous land vehicles. 


The purpose of the system is only to determine the range and direction of 
environments in which the above vehicle can travel. We have carried out the 
developmental work to establish a low-level image processing technology for 
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autonomous land vehicles which feature sufficient inflexibility and real 
time in restricted environments. 


3. System Configuration 
3.1 Hardware 
The following is a description of the hardware systen. 


The autonomous traveling experimental vehicle is a cleanroom land vehicle 
equipped with an image processing device. 

The cleanroom land vehicle is driven with motors installed on the right and 
left in the center of its body. Also, casters are installed on the front 
and rear of the body. Data are shown in Table 3.1. 


Table 3.1 Data 





Overall length 140 ca 
Overall width 67 cm 
Overall height 128 ca 
Weight 200 kg 
Maximum speed 2.5 ka/h (two motors with 120 wDC) 





The system, which mainly consists of a personal computer [PC], is stored and 
installed in the rack of the upper portion of the body. 


Visual information is input with a three-plate-type color charge coupled 
device [CCD] camera. 


Currently, only information on the surroundings of the autonomous traveling 
experimental vehicle is imaged, and is necessary for the locomotion of the 
vehicle. The height of the camera and the tilt angle are adjusted to 
prevent the surrounding walls, etc., from reflecting on the floor as much 
as possible. In addition, the pan and zoom are fixed while the vehicle is 
traveling. 


Respective frame memories (R, G, and B) in which images are taken measure 
240 x 256 x 6 bits. The frame memory is mapped for the central processing 
unit [CPU]. 


The external recognition, behavior selection, and traveling control are 
carried out using a PC-9801VX made by NEC Corporation. The PC is based on 
an 80286 mode, and is equipped with numerical data processor [NDP] 80287. 


Also, an image pipelined processor [ImPP] board is used to increase the low- 
level image processing speed. The ImPP has a maximum image processing speed 
of 5 million instructions per second [MIPS], and four ImPPs are arranged n 
the pipeline. In order to use the ImPP, it is necessary to transfer 
information on images from the frame memory to the image memory mapped in 
the ImPP. 
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The number of wheel rotations and the traveling distance can be calculated, 
because pulses are input from the rotating sensor in the wheels to the 
counter. 


The autonomous traveling experimental vehicle is driven by two direct 
current [DC] motors installed in the center of the body, and the rotating 
direction and the number of rotations of the motors can be determined 
independently. The motors are controlled by hardware. 


In addition, two infrared sensors for detecting obstacles are installed on 
the front and rear of the vehicle, and four contact sensors are installed 
on the front and rear bumpers, respectively. The fail-safety is realized 
by using these sensors on the basis of hardware logic prior to software 
involvement. 


Both the power source for driving the motors and that for image processing 
equipment are supplied from batteries incorporated in the same location. 


The hardware configuration is shown in Figure 3.1. 
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Figure 3.1 Hardware Configuration 
3.2 Software 
The following is a description of the software. 
The system mainly consists of the following three sections, i.e., 
1) external recognition section, 2) behavior selection section, and 
3) traveling control section. 
The autonomous traveling experimental vehicle acts on the basis of 


instructions in which the kinds of targets and behaviors required for these 
marks are indicated. 
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Development has been carried out up to now to evaluate the real-time and 
inflexibility of low-level functions of item 1) above. 


Here, the function of the above three sections will be described. 
(1) External recognition section 


Low-level external recognition is carried out in this section, i.e., it is 
detected in accordance with the target. 


(2) Behavior selection section 
Behavior is selected based on the behavior instructions in this section. 


Behavior is currently selected at a low level since only the low-level 
functions of the external recognition section are realized. That is, 
targets which should be detected are indicated to the external recognition 
section, and behavior is selected for the detected targ>t. 


(3) Traveling control section 


Tracks are generated in this section. The number of rotations and the 
rotating direction of the right and left wheels are determined in order to 
correspond to the tracks generated. 


The track generation and selection are realized on the PC by using C and 
assembler, as well as the ImPP assembler. 


4. Indoor Locomotion end Experimental Results 
4.1 Detection of Targets 


When the autonomous traveling experimental vehicle locomotes on corridors 
and inside rooms, the basic task is to detect a target in the environment. 
The external recognition section plays a role in detecting this target. The 
kind of target that should be detected is indicated by the behavior 
selection section. 


As previously mentioned, there are two kinds of targets which should be 
detected. One is a continuous target, such as the end of a corridor or the 
end of the traveling path, as marked by cloth tape, and the other is a 
dispersed target based on a figure formed by abstracting the environment in 
a certain location, such as an intersection between corridors. 


Here, methods of detecting the two kinds of targets will be described. 
4.2 Detection of Continuous Targets 


There are two types of continuous targets. One is a continuous target, such 
as the end of a corridor which is already in existence, and the other one 
like the end of a path that has been set as part of the environmental 
organization. 
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The behavior selection section gives the external recognition section 
information on the path surfaces and corridors that is necessary in order 


to process images. 
Following is an explanation of this information. 


As shown below, picture elements (R,G, and B) of the floor surface on which 
the autonomous traveling experimental vehicle locomotes are normalized to 
find the normalized picture elements (r, g, and b).’ 


r= R/T 
g - G/T 
b = B/T 
Te-R+GC+8B 


As shown below, averages, »,, #,, and » of r, g, and b are found with 
respect to the number of Ns of the normalized picture elements. WN is 
experimentally determined according to the corridors and paths. 


232 
er Ty 


In addition, the following values have been deterained, respectively, for 
r, g, and b. 


min, = #, - Cy, Max, = B, + Cy, 
ming = Hy - Cy BAX, My + Cy 
min, = m - %, BAX, — My + Cry 


where, Cri, Cru, Seis Cgur Spx, Amd Cy, are nonnegative values which can be 
found by conducting experiments. 


When edges are used, a face is determined from R, G, and B by conducting 
experiments. This face must be optimal for detecting paths, path ends, and 
corridor ends which border corridors and walls. 


This process is carried out by using information on edges and color. That 
is, a candidate point for the path end or corridor end is detected with 
edges, and subsequently is confirmed using color information. 


As shown below, this process is carried out for every line. 


(1) An edge operator carries out the process for a line in the face as 
determined in advance. 


(2) As a result of investigating the information on edges extending from 
the path face or corridor face to the path end or corridor end, when the 
absolute value which exceeds a certain value is determined, the position of 
the absolute value will be selected as a candidate point for the path end 
or corridor end. 
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As a result of carrying out this process, even when the illumination 
reflected on the floor creates a great difference in color between the floor 
and other places, the influence of this reflection can be avoided by 
detecting a candidate point based on edge information since the change from 
the floor to places affected by illumination is not acute. 


(3) Normalize the picture elements R, G, and B) of line sections which are 
outside the candidates for the detected path end or corridor end, and check 
to see if the normalized picture elements (r, g, and b) satisfy the 
following three conditions. 


If the normalized picture elements do not satisfy even one of the three 
conditions, they will be regarded as picture elements referring to places 
other than paths or corridors. If such picture elements continue for a 
certain period, the path end or corridor end wiil be detected. 


If not, a candidate point will be detected from the floor design, etc., and 
item (2) will be repeated. 


When foreign matter, such as flash plug receptacles, etc., exist under the 
floor, and it is permissible to regard them as a part of the floor, the 
number of conditions for judgments should be increased. 


Figure 4.1 shows the quantity calculated from the one-line processing course 
and the results obtained from the processing. 


Such processing is carried out for necessary lines in accordance with the 
complexity of the environment within the photographic range, and the path 
end or corridor end is obtained for the respective lines. 


The position of a continuous target obtained on the image by carrying out 
the above processing is converted into an actual position by using a table. 


Next, the track is created, and the position of a safe target is selected 
by taking into consideration the position of the target for every line. 


ImPP implementation is carried out taking the following points into 
consideration to increase the speed of the above-mentioned processing. 


(1) The access to the image memory is minimized and scattered. 


(2) A large amount of data is not transmitted continuously to the identical 
arc. 


(3) The processing quantity is equalized for each ImPP. 
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Figure 4.1 One-Line Processing 
4.3 Creation of Track for Continuous Target 
When a continuous target is detected, a track for it will be created. 


When environments are assumed to be extremely complex, they will be arranged 
by using figures obtained through abstraction. Accordingly, we are not 
studying the case in which concave and convex portions, etc., of the wall 
prevent the targets from being detected while the autonomous traveling 
experimental vehicle is operating, thereby making this vehicle inoperable. 


Therefore, when an arc track is created simply for continuous targets, the 
vehicle can travel in the environment. Figure 4.2 shows a method for 
creating this arc track. 


A continuous target is detected at B on the assumption that the autonomous 
traveling experimental vehicle is currently traveling on P. A track with 
a radius of R is created so that the vehicle approaches this target while 
maintaining a distance of d. In this case, th: number of rotations, N, and 
N., of the wheels should be selected so that the following equation holds, 
since the radii of the arcs which are the tracks of the right and left 
wheels are r, and r,, respectively. 


nN. fe 
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Figure 4.2 Creation of Track for Continuous Target 


The interval of track creation should depend on how precisely tracks are 
created for each target. 


4.4 Detection of Diverse Targets 


Diverse targets are obtained by abstracting the physical environment. These 
diverse targets may also indicate environments which require the autonomous 
traveling experimental vehicle to take actions expected by the humans. 


In the same way as that in which continuous targets are detected, 
information necessary for processing images and information on the size and 
color of figures comprising diverse targets are transferrod from the 
behavior selection section to the external recognition section. 


Similarly, the detection of diverse targets is carried out by using 
information on edges and color. 


That is, after detecting a candidate point for a target on a certain line 
of the image plane by using edges, cv firm that the color .f the candidate 
point agrees with that of a predetermined diverse terget. In any case, 
edges are detected again. When the colors do not agree, and when the next 
edge is detected in the same way as has already been “one, judge whether or 
not the candidate point is a target. When the colors agive, and when the 
next edge is detected, determine whether the candidate point is a floor, 
i.e., whether the target ends at this point. When the target ends, the 
target detection on the line will be completed. 


Figure 4.3 shows one-line processing. 


Determine if the candidate point is of an adequate size to read information 
indicating targets by conducting the same operation for some lines on the 


image plane. 
If the size is not adequate, the candidate point will approach the target, 


and the target will be detected again when the size becomes sufficient. In 
this case, the investigation range for detection can be reduced, because the 
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Figure 4.3 One-Line Processing 


position and size of a target can be anticipated. Also, this target should 
be detected from the results of detecting the previous target. 


This process was implemented in the InPP. 
4.5 Creation of Tracks for Diverse Targets 


Following is a description of track creation when diverse targets are 
detected. 


Tracks for diverse targets are created by combining straight lines and arcs. 


Figure 4.4 shows a typical method of creating a track when corridors 
intersect. A diverse target is detected at T on the assumption that the 
autonomous traveling experimental vehicle is recently traveling on P. The 
vehicle travels distance L in a straight line toward this target, and a 
track with a radius of R is created. The target is selected after having 
taken the structure of the environment and the speed of the vehicle into 
consideration, because information on R is not included in the target 
itself. Similarly to that of continuous targets, the creation of tracks is 
carried out by using the difference between the number of rotations of the 
right and left wheels. 
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Figure 4.4 Creation of Track for Diverse Target 


4.6 Experimental Results 


Traveling experiments were conducted in common environments, such as 
corridors and room interiors, in which neither a continuous target, diverse 
target, mor other target head been made, and existing continuous targets 
were used. 


As a result of detecting the continuous targets existing the most in these 
environments and to locomote at a high speed, a maximum traveling speed of 
2.5 ka/h was realized. 


It is necessary to frequently transfer image data in the present systen, due 
to the hardware configuration restrictions. The overhead is high, but the 
feasibility and usefulness of real-time processing of low-level images have 
been confirmed with the ImPP. 


Also, the stability was confirmed since the autonomous traveling 
experimental vehicle could cope sufficiently with usual indoor disturbances. 


When environments not specifically designed for autonomous carriers are 
slightly arranged. the vehicle can travel sutonomously within the 
environments. Therefore, we believe that the vehicle has reached the 
practical level as an indoor autonomous carrier. 


5. Conclusion 


We have developed the above vehicle which locomotes in specific environments 
prepaid by humans on the premise that such vehicles will be applied as 
intelligent locomotive robot for industrial purposes. We have used 
prearranged environments as much as possible so that the humans and vehicles 
can sove in them, while minimizing the environmental rearrangement. The 
travelable range and direction within these environments have also been 
determined. 


The use of our system has confirmed the real-time characteristics and 
stability of low-level external recognition of images, which become 
important in such environments. 
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{Text} 1. Introduction 


This paper describes methods to control office automation [OA] locomotion 
robots. The operation of robots in offices must be coordinated with human 
actions. Therefore, recognition ability, intelligent judgment, and flexible 
mobile functions are required for these robots to some extent. In places 


functions of these robots sust be selected. 


Research on visual devices has been conducted actively for use in 
controlling locomotion robots. The man contents of the current visual 
technologies involve incorporating information on color and lightness into 
these robots through the use of sensors, such as CCDs, and identifying 
information on the distance and shape of objects on the basis of the visual 
information. For this reason, complex and lengthy processing is required 
for these technologies, and it is difficult to obtain control information 
suitable for the speeds required by locomotion robots. Actually, locomotion 


these locomotion robots. It cannot be denied that advances must be made 
toward practical use. 


Accordingly, the authors have studied a system to uniformly control 
information on a number of sensors, regardless of the kind of sensor, by 
using a simple sensor system which can directly detect the information 
required by locomotion robots, and have devised « control system, called 
"Potential Servo Systes," as shown below. 
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(1) A potential space which can be recognized by the robot is provided in 
the robot itself. 


(2) Strain is made in this space so that it can individually correspond to 
@ goal of sensor information. 


(3) The robots’ motions are controlled to enable them to pass from 
nonequilibrium to a stable equilibrium in the potential space caused by this 
strain. 


The adoption of this system will bring about the following. The robot can 
travel autonomously only by setting an objective evaluation criterion in 
which the sensor output is combined with programs as a strain that has « 


shape. 


This peper will describe details of the potential servo systes, will 
introduce examples applicable to controlling the autonomous evasion of 
obstacles, and will confirm the validity of this autonomous control. 


2. Potential Servo Systes 


The potential servo system devised by authors, et al., is applied to control 
theoretical robots in potential fields. 


The potential field in this system means that the potential value is defined 
by multidimensional curved-surface functions, P = P (X,, X,, *** X,), (%, L. 
++ KX, are state variables) in a virtually sultidimenstonal space (Potential 
Space) in which a potential [P) axis is added to a multidimensional space 
(basic space or state space) determined by the robot's degree of freedom and 
the space in which the robot moves. This system produces « continuously 
curved surface, as shown in Figure 1, on this potential space, based on the 
signals emitted from a sensor installed in the robot, and automatically 
induces the robot to bypass high-potential places, while remaining in a low- 
potential place, by providing virtual acceleration in the negative direction 
of the P axis. 


x vy 


Figure 1. Potentially Curved Surface 


A locus generated on the potential space mentioned above can be used 
input to directly control the robot since, as shown in ; 
respective coordinate axes, except for the P axis, accord with those in 
state space of the robot. Accordingly, the system can be 
incorporated into robots as a host system for conventional servo systen. 
Here, detail of the system will be described. 
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A silts 
Figure 2. Potentisi Space and State Space 


First, the authors, et al., classified the sensors found in robots into 
environmental and state sensors, s% zi#*wn in Table 1. Environmental sensors 
are used to recognize the environment surrounding the robots. The 
ultrasonic sensor, infrared sensor, force sensor, limit sensor, etc., can 
be cited as environmental sensors. On the other hand, state sensors are 
used to recognize the state within the robots, i.e., articulated angle, 
locomotive speed, position, power consumption, etc. The encoder, tacho- 
generator, etc., can be <!i#é as state sensors. The system produces the 
previously-mentioned continuously curved surfaces based on the signals 
emitted from environmental sensors. The rules of production are shown 
below. 


Table 1. Kinds of Sensors 





Environmental sensor Ultrasonic sensor, infrared sensor, force 
sensor, etc. 


State sensor Encoder, tachogenerator, etc. 





(1) The potential is higher than the standard level and is increased in the 
positive direction of the P axis in portions corresponding to states 
presenting obstacles in facing the robot during its transit to the given 


goal. 


(2) Imversely, the potential is lower than the standard level and is 
increased in the negative direction of the P axis in portions corresponding 
to states which bring about advancement. 


(3) Other spaces (portions for which neither obstacles nor advancement can 
be designated) are turned into a state of equilibrium (standard level). 


The following methods of mathematical expression have been devised, based 
on the above rules, to describe environments comprising continuously curved 
surfaces. 


(1) A fundamental function mentioned later is modified with the sensor 
output, and a convex of concave function is defined for the sensor output, 
and a convex or concave function is defined for the sensor output on the 
assumption that the environmental information involving robots is 
individually responded to by each sencor. 
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(2) Algorithm is defined so that it can be applied to the intervals between 
functions defined for every sensor output, and a function defined for every 
scusor output is compounded as a curved surface function in accordance with 
the algorithn. 


(3) Assuming that the virtual acceleration of gravity sets in the negative 
direction of the P axis, a robot locomoting in the potential space receives 
th‘s virtual acceleration of gravity as a reaction force from concave and 
comvex surfaces and functions using this reaction force. 


It is easy to logically combine sensor information with other information 
and to mathematically process the sensor information regardless of the 
physical dimensions originally provided in the sensor output because, in 
this system, sensor output is defined as a fundamental function and, in 
addition, all sensor outputs are compounded as a curved surface function 
through the definition of the algorithm between fundamental functions. For 
example it is possible to judge whether the object is an animal or inorganic 
matter by logically producing the output of a infrared sensor combined with 
that of an ultrasonic sensor. 


After potential curved surfaces are produced, based on various sensor 
outputs, it will be necessary to describe equations of r=<ion of a 
locomotive object (a robot itself) whose motion is controlled with the 
potential field. We can frequently view the motion as a phenomenon in which 
an object moves from a high potential place to a low potential one. The 
motion of objects due to gravity can be cited as an example. The 
acceleration of gravity has been adopted as a dynamically constrained 
condition in this system to obtain the speed control command value of the 
robots. 


As was previously mentioned, the potential servo system consists of the 
following three processes, and is expressed by the processing flow shown in 
Figure 3. 


Y 


-+- Image converting 
process 


}~ Image operating 
process 


+ Converting process 

















Figure 3. Control Algorithm 
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(1) Image converting process: modifies fundamental functions, depending 
on sensor signals. 


(2) Image operating process: obtains a curved surface function ¥ by 
mutually functioning converted images. 


(3) Operating process: calculates the inclination of potential fields and 
obtains speed command values by using the virtual acceleration of gravity. 


3. Potential Servo Executing Process 


3.1 Image converting process 


This process determines the producing position and shape of the fundamental 
function P, defined in the potential space, on the basis of signals output 
by sensors. 


For example, the information on the position of an obstacle, obtained 
through an ultrasonic sensor, merely shows a one-dimensional distance. 
Then, in the same way as conventional methods, it is converted into 
information on multidimensionally relative positions as viewed from the 
robot’s characteristic coordinate systems. This method is the same as 
conventional ones up to this point. 


First, the fundamental function P is defined for information on the relative 
position, obtained by using the above method. P becomes a nucleus for 
mapping sensor output in the potential space. The multidimensional normal 
distribution function shown in Figure 4 was used in the system. It is easy 
to mathematically analyze the normal distribution function based on an 
exponential function since the normal distribution function is continuous 
and can be differentiated for variables of state. Some methods of mapping 
sensor output on the potential space can be studied with this normal 
distribution function, and the following method was adopted for applicable 
examples of obstacle evading control using an ultrasonic distance sensor. 





Figure 4. Shape of Fundamental Function 
Now, R is defined as shown in the following equation: 
R? =| X=X, |? 


where, X: Position of robot on characteristic coordinate system 
X,: Position of obstacle 
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The fundamental function P expressed by equation (1) is defined within the 
potential space as the function shown in Figure 4, which is the maximum for 
an obstacle’s position. 


P(R) = K*exp(-R*/2 o*) (1) 


where K: proportional constant 
o: standard deviation 


In addition, a potential curved-surface can be formed by successively 
defining such functions for every sensor output and by compounding these 
functions in the image operating process explained in the following 


paragraph. 


On the other hand, if robots locomote in absolute spaces, potential spaces 
produced in this system will move in the same way since the potential spaces 
are based on the robots’ characteristic coordinate systems. Also, potential 
values of arbitrary positions of robots on characteristic coordinate systems 
can be found promptly since potentially curved surfaces are defined only n 
sensor detecting domains. 


Accordingly, this system can dynamically produce potentially curved surfaces 
on potential spaces in accordance with the robot’s motion, and can control 
these robots while observing. 


Robots can generate their loci autonomously and can move in environments 
while dynamically recognizing these environments. 


3.2 Image Operating Process 


This process compounds fundamental functions defined for every sensor output 
in the previously-mentioned image conversion process, summarizes them as a 
curved surface function @, equation (2), and defines potentially curved 
surfaces. 


As mentioned previously, the mutually arithmetic sum, difference, product, 
and quotient among the functions can be expressed with equations (3) to (6), 
with all of their nuclei retained as exponential functions, and the 
differentiability and continuity are maintained since the nuclei of the 
fundamental functions are exponential functions (Figures 5 to 8). 


Therefore, when fundamental functions are defined for every sensor output 
and are totaled, the environment surrounding a robot will be expressed as 
a stereoscopically potential field, as shown in Figure 1. In addition, even 
when the robot locomotes within this field, the field will change 
dynamically, and the robot can be controlled using real-time, since the 
field is renewed with every sensor output. 
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Operations are carried out only by using sums and differences, since only 
the ultrasonic sensor has been used as an environmental sensor up to now. 
However, considering operati-=ns among such sensors as infrared and pressure 
sensors, the product and quotient are promising as future operators. 


# - 2K, * exp(-R,?/20,*) (2) 
P, + P, = K, * exp(-R,*/20,*) + K, * exp(-R,’/20,*) (3) 
P, - P, = K, * exp(-R,*/20,*) - K, * exp(-R,*/20,*) (4) 
P, * P, = K, * K, * exp(-R,*/20,* - R,*/20,*) (5) 
P,/P, = K,/K, * exp(-R,*/20,* + R,*/20,*) (6) 


3.3 Conversion Process 


This process obtains speed command values for robot locomotion by using the 
inclination of the potential surfaces produces. 


Now, as a result of conducting the operations mentioned in the previous 
section, assuming that the potential surface is compounded in a shape like 
that shown in Figure 1, as shown in Figure 9, the inclination of an 
arbitrary point (point A shown in Figure 1 is regarded as an example of the 
arbitrary point) of the robots’ characteristic coordinate systems is found 
per axis of the characteristic coordinate systems. Let's take one of the 
axes, axis X, as an example. As shown in Figure 9, the acceleration 
assigned to a robot at point A in the direction of this axis is decomposed 
and found in each axial direction on the assumption that the virtual 
acceleration of gravity is applied at point A in the negative direction 
(axis P). 
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Figure 9. Calculation of Potential Grade 


That is, the robot receives virtual force in the opposite direction 
according to the inclination of the surface. Accordingly, the robot can 
evade high potential sections, such as obstacles, and inductive force can 
be exerted so that the robot can be induced to low potential sections as a 
goal. Then, speed command values are made per axis by differentiating the 
obtained induction acceleration of the first order and by converting it into 
speed. When the robot can be controlled according to the speed command 
values, it will be possible for it to evade obstacles autonomously. 


4. Applications to Practical Systens 
4.1 Application to Obstacle Evasion Problems 


The application of this system to practical systems is being considered 
based on the methods explained previously. 


The application of the system to autonomous obstacle evasion robots is being 
considered by using an ultrasonic sensor, a gyroscope, and an accelerometer. 
Such robots locomote in two-dimensional planes as moving spaces. (Figure 
12 shows a system configuration of a locomotion robot.) 


First, obstacles are detected by an ultrasonic sensor, which is an 
environmental sensor, and the position and posture of the robot itself are 
detected by a gyroscope and an accelerometer, which are state sensors. As 
shown in Figure 10, the ultrasonic sensor, gyroscope, and accelerometer are 
installed in the robot. 
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First, obstacles are detected by an ultrasonic sensor, which is an 
environmental sensor, and the position and posture of the robot itself are 
detected by a gyroscope and an accelerometer, which are state sensors. As 
shown in Figure 10, the ultrasonic sensor, gyroscope, and accelerometer are 
installed in the robot. 











Figure 11. Produced Potential Function 


When the robot is positioned in an environment similar to that shown in 
Figure 10, the output of the ultrasonic sensor will be converted into the 
robot's characteristic coordinates at the coordinate conversion section 
shown in Figure 12, and the relative position seen from the robot is 
recognized, as shown in the figure. A target position is given to the robot 
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in advance, a relative position is found by using the target position while 
the current position is measured with a gyroscope and an accelerometer, and 
a concave section is formed on the relative position. 
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Figure 12. Block Diagram of Potential Servo Control System 


When convex sections formed in the position of recognized obstacles are 
piled on the concave section (image operating process), a potentially curved 
surface, similar to that shown in Figure 11, will be completed. 


Then, the induction acceleration at the sensor installation position is 
found during the operation process by taking into consideration the fact 
that characteristic coordinates of the robot accord with coordinate systems 
of the potential space, except for axis P. 


A position control system works in the robot. It is equipped with a 
gyroscope and an accelerometer independent of the above-mentioned gyroscope 
and accelerometer. Speed command values output by this system are corrected 
with the correction values output by a potential servo, and are output to 
the lower control systen. 


From the results mentioned previously, it can be said that the robot will 
autonomously trace evading loci against obstacles, and will be induced to 
approach the goal. We have confirmed the validity of this system by 
applying the system to an actual locomotion robot. 
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# = EX, * oxp(-R,,2/20,") (7) 


where Rg,” = (x, - x,)? + (Y, - Y,)? 
(X,, %); sensor installing position 
(X;, ¥;); position of obstacle 


40/aX = =X,/o," * (X, - X,) 


* exp(-R,,"/20,*) (8) 
at /av - X * (¥, - Y;) : 

* exp(-R,,*/20,*) (9) 
a = tan’ (49/AX) (10) 
p = tan’ (49/AY) (11) 
F., = -M * G/2 * sin(2a) (12) 
Fy, = -M * G/2 * sin(26) (13) 


5. Conclusion 


This system produces virtually potential curved surfaces on the basis of 
signals emitted from sensors, and induces the robot toward the goal by using 
the acceleration obtained from the inclination of the surfaces. It has been 
confirmed that the system is effective as an autonomous locomotion robot 
controlling method due to sensor feedback. However, many points remain for 
further study, e.g., the shape of fundamental functions, curved surface 
compounding methods, etc. Accordingly, in order to put the system to 
practical use, it is necessary to conduct further research on the systen. 
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object vertex is observed. However, after the shape, position, and attitude 
of the objects are defined with variables, if the observation model f(x) can 
be deduced from the definition of the object shape and that of the 
observation quantity, a general-purpose measurement system using images can 
be constructed. A system combining the measurement system and the CAD 
system has been called, “Model Based Measurement System." The environmental 
model-making system is an example of such model measurement systenus. 


Figure 3 shows the configuration of an environmental model-making systen. 
This system is a subsystem of environmental model control systems which 
control environmental models of locomotion robots. 











Figure 3. Configuration of Environmental Model-Making Systen 


The environmental model-making system consists of a) a model editor which 
defines the shape model and observation model of the observed values, 
b) an observation system which inputs images into a computer, c) an 
observation equation synthetic system which deduces an observation equation 
from the observed values and the definition of shape and observation models, 
d) an observation equation solving system, and e) the human interface. 


The environmental model-making system manufactured by the authors possesses 
the following features: 


(1) The system defines the shape by using model description languages 
[MDLs}. 


(2) Variables can be used to describe models, and can be estimated by 
measurements. Therefore, shape variable objects, such as humans and chairs, 
can be defined. 


(3) Even if the kinds of observation quantities change, the system can 
correspond to the change since the observation models of observation 
equations can be defined. 


(4) If the system can observe, it will be able to estimate variables 
regardless of the observation quantities and kinds of variables which should 
be estimated. 


(5) The known information and observation quantities can be combined by 
using the nonlinear least squares method. 
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(5) Deformation by Euler's operation. 


This system possesses (1), (2), and a portion of (4) above. The function 
mentioned in item (1) has been expanded over that of conventional CAD 
systems. The system does not process any data on numerical values, but 
processes functions which output shape models as data. Figure 5 shows 
specifications of the system. The function described with MDL does not 
output any data on vertex numerical values, but outputs variables which 
should be estimated as arguments. 


(rectangular (x y) 
(vertexes(] (x y 0)) (2 ((-x) y 9)) 
(3 ((-x) (-y) 0)) (4 (x(-y) 0))) 
(lines(1 (1 2)) (2 (2 3) (3 (3 4)) (4 (4 1))) 
(planes(1 (1 2 3 4)) (2 (1 4 3 2)))) 


Figure 6. Surface Model of Rectangle 


Figure 6 shows the most primitive sentences. These sentences express 4 
rectangle as a surface model. Models are defined by combining such 
primitive sentences. Figure 7 shows the description of a desk. 


(desk (x y r h &optional(dx 0.03) (dy 0.03)) 
(declare(x2 (- (/ x 2) dx)) (y2 (- (/ y 2) dy)) 
(array leg (legl leg2 leg} leg4)) 
(array legpos ((x2 y2 0) ((-x2) y2 0) 
((-x2) (-y2) 0) (x2 (-y2) 0)))) 
(beard (move (0 0 h) (rectangularxy))) 
(for (i 1 4) 
((leg 1) (move(legpos 1) (cylinderr h))))) 


Figure 7. Example of Description of Desk 
5. Description of Observation Model 


Observation quantities in images are multiform, for example, the position 
of the vertex, linear equation, axis of a cylinder, radius of an ellipse, 
etc. The measurement system must be able to define model functions of these 
observation quantities. 


If the position of the vertex of objects on an image plane is expressed with 
a function, such as the Lisp function, on the assumption that the position 
and attitude of these objects and those of a camera are described with an 
absoiute coordinate system, the following items can be obtained: 1) 
perspective transformation--lens characteristics; 2) inverse rotation-- 
position of camera; 3) inverse translation--attitude of camera; 

4) translation--object positions; 5) rotation--attitude of objects and 
coordinate of vertex of objects. The inverse rotation and inverse 
translation refer to the inverse transformation of rotation and translation, 
respectively. When they are defined using MDLs, observation models are 
defined by combining transformation functions, such as translation, 
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Tele-Vehicle I--Autonomous Remote Controlled Vehicle 
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[Article by Hideaki Ohyama and Akira Tate, Mechanical Engineering 
Laboratory] 


[Text] 1. Introduction 


The authors, et al., have manufactured a remote controlled experimental 
vehicle, “Tele-Vehicle [TV]-1," have conducted research on remote control 
technologies, and have shown that complex work can be conducted by employing 
remote controlled robots, instead of humans, in their research laboratory. 
However, the work to be conducted by robots does not only involve complex 
work requiring human direction at all times. For example, the realization 
of autonomous control robots will relieve the human operation load in work 
which is relatively easy for robots to autonomously carry out, such as 
locomotion in familiar and unmanned environments. 


This report describes an interactive environmental model-making system as 
an environmental model constituting method, which is one of the elemental 
technologies for enabling locomotion robots to autonomously carry out the 
work, and confirms the validity of this system. First, the TV-1 will be 
explained briefly and the environmental sodel-making system will be 
described. 


2. Remote Control Experimental Vehicle (TV-1) 


The TV-1 will be explained briefly.’ The TV-1 is a locomotion vehicle 
similar to that shown in Figure 1 [not reproduced). Basically, the TV-1 is 
remote controlled by humans. The portion of the work previously done by 
humans is carried out by an autonomous vehicle, TV-1, but the TV-1 is not 
sufficiently autonomous to replace humans. Therefore, importance is 
attached to interfacing between the TV-1 and humans. 


An autonomously locomotion system for the TV-l1 is currently being 
manufactured. This system is comprised of an environmental sodel, 
interprets ccmmands from humans on the basis of this model, makes a track 
plan, and transmits these commands to the TV-1 itself. The system is 
expected to have a configuration as shown in Figure 2. 
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3. Model-Based Measurement Systes 


Research involving the construction and use of environmental models is 
currently being conducted as an important subject for the field of 
robotics.**? Although the necessity for the use of environmental models has 
been advocated, the number of robotic systems using environmental models is 
mot yet large. It is not easy to sake general environmental models, which 
is one of the reasons that .ach models are not being universally employed. 
However, even if it is difficult to model general environments, it is easy 
to model specific environments, such as research laboratories, factories, 
and space. High-level functions can be expected in these places by making 
environmental models and adopting methods for taking action on the basis of 
these models. 


Data on most basic environmental sodels show the three-dimensional shapes 
of buildings and objects, as well as their positions and attitudes. The 
view exists that conventional computer aided design (CAD) systems should be 
used to make environmental models, but conventional CAD systems are 
unsatisfactory since, although environmental sodels of buildings can be made 
by reading data in CAD systems, other factors in addition to building models 
which can be restored with design drawings are required for locomotion 
robots, even in relatively prepared environments, such as factories and 
research laboratories. Objects such as desks, chairs, and lockers exist in 
rooms, and objects are also placed in corridors. It is necessary to measure 
and register the position, attitude, and shape of these objects. Ideally, 
the robots would automatically carry out the measuring and registration, but 
it is currently very difficult for them to do so. Also, it is preferable 
that the human-robot system have an environmental model that can be 
understood by both the humans and robots. 


Therefore, it will be necessary to develop a system which verbalizes 
environmental models by combining a conventional CAD system and a 
measurement systen.‘ 


Assuming that a parameter which should be estimated is x, the observed value 
is y, and the observation model is f(x), the measurement can generally be 
regarded as a process for estimating x, since the equation, y = f(x), holds. 
Now the following case will be considered. The shape, position, attitude, 
etc., of objects are to be estimated from images. Even when the same kind 
of observation quantity, called the “Vertex Position," exists, f(x) will 
change depending on the element, x and the kind of object. When identical 
objects are involved, the shape of f(x) will change according to which 
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rotation, persnective transformation, etc., with functions vhich derive 
vertex coordinates and coordinates of both ends of line seguents from 
models. When all arguments are numerical values, they will be evaluated as 
normal Lisp functions in the observation models. When arguments include 
variables, they will not be evaluated. It is mot until the value of these 
variables has been determined that the arguments will be evaluated. 


6. Coordination 


The position of objects on input images can be obtained by pointing the dots 
of these input images. When shape sodels are displayed by substituting 
appropriate values for variables, when the dot corresponding to 
of these shape models is pointed in 
models of the vertex of the shape 
position of the images input observa 
linear case is the same as was mentioned 


Even if the straight lines and model vertex specifications deviate slightly, 
the deviation will not pose any problems since these straight lines and 
vertices have been selected from input values, minimizing the distance 
between the straight lines and the vertices. However, the specifying of 
such straight lines and vertices on input images must be carried out with 
high accuracy since this specification will directly bring about observed 
values. Figure 8 jnot reproduced) shows an image plane at the time of 
coordination. 


7. Observation Equation Solving Systen 


Observation equations are solved in accordance with the following 
procedures. A flowchart is shown in Figure 9. 


(1) Receive lists of restricted conditions, data on observation error, 
observation equations, and variables which should be specified. 


(2) Add these restricted conditions to the list of the observation 
equations in accordance with the kind of restricted conditions. 


(3) When variables not included in observation models exist, check for no 
observability. 


(4) When observation equations and variables can obviously be divided into 
classes, carry out the division. 


(5) Check *o see if observation equations can be solved with « solution 
defined by the users. When they can be solved with the solution, start its 
routine. 


(6) Start using the nonlinear least squares sethod. 


(7) Estimate the accuracy from the Jacobian matrix for observation models 
and data on the errors of observed values. 
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Figure 9. Solution of Observatſon Equation 


Generally, it is difficult to analytically solve -«rlinear simultaneous 
equations. Even if they can be solved analytically, .t is very difficult 
to obtain the optimum estimate by combining information on errors of 
observed values with known and restricted conditions. Accordingly, this 
syste adopts the nonlinear least squares method as a main solution. 


In the case of nonlinear problems,it is difficult to analytically 
investigate the observability. However, when the number of variables is 
smaller than that of observation equations, or when the variables are not 
mentioned in the list of observation equations, there will be no 
observability. Therefore, warnings will be given to users, and the input 
of new observation equations will be promoted. The final determination of 
observability is carried out by using the nonlinear least squares method 
and the Jacobian matrix. 


In order to solve problems by using the least squares method, it is 
necessary to use information on the observation model, the error 
distribution of the observed values, the observed values, the initial values 
of variables which should be specified, and these variables themselves. In 
the case of nonlinear problems, there is no assurance that these problems 
can be converged into a true solution. That is, they may be converged into 
a locally minimal solution. Therefore, it is necessary to provide a number 
of initial values. 


The Marquardt method is used as an algorithm for the nonlinear least squares 
method.”. The Marquardt method requires Jacobian matrices for observation 
equations, but, except for special cases, observation equations can be found 
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using the difference approximation. The Jacobian calculation speed based 
on the difference approximation is low, but the accuracy is the same as that 
of analytical calculating methods.°® 


8. Handling of Restricted Conditions 


In the case of monocular vision, it is difficult to estimate variables which 
express dimensions without any known information. Measurements can be 
carried out while moving a camera, but this system is used to measure fixed 
points. In order to measure variables expressing dimensions, it is 
necessary to use known information. For example, information on desks and 
chairs can be used, because their dimensions have already been determined. 
However, it is necessary to be careful when using such information. 
Measurement accuracy depends on the precision of known information. 


The following items can be cited as expressions of known information. 


(1) The probability distribution of values of expressions. 

(2) Equality restricting conditions. 

(3) Inequality restricting conditions. 

(4) The domain of definition of variables in the special case termed 
"Inequality Restricting Conditions." 


It is difficult to handle the probability distribution of general 
expressions. Practically speaking, it is believed that the handling of 
uniform and normal distribution will be satisfactory. When the probability 
distribution of values of expressions is normal, it is easy to handle the 
normal distribution by using the least squares method. These expressions 
should be added as observation equations to observation vectors. When the 
probability distribution of values of expressions is uniform, or when it has 
inequality restricting conditions, the probability distribution must be 
handled with a penalty method. Domains of definitions of expressions and 
inequality restricting conditions are added as penalty function arguments 
to observation vectors. Im the case of inequality restricting conditions, 
a variable is converted into another variable, if possible, with these 
conditions, while, if impossible it is added as a penalty function argument 
to the observation vectors. 


9. Solution Defined by Users 


This system can find the value of variables numerically from the value of 
observation quantities and the relationship between the observation 
quantities and variables, which should be estimated. However, if the value 
of these variables can be found analytically, in many cases the value can 
be solved stably at a high speed, and no uncertainty is caused when the 
value is solved numerically. As mentioned above, the value of the variables 
is found analytically from a relationship between the observation quantities 
and variables. This is a kind of mathematical expression processing method. 
Then, ideally, it is necessary to incorporate mathematical expression 
processing technologies into CAD systems for measurements. Currently, the 
above system does not possess any mathematical expression processing 
function, but when problems requiring solutions can be solved with a 
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solution defined by the users, the solution can be initiated. For example, 
of four points of an object having a known shape, which exists on a plane, 
can be coordinated, the attitude and position of the object can be estimated 
analytically. If those of one which does not exist on a plane can be 
coordinated, the approximate solution of the attitude and position of the 
object can be found analytically. If the nonlinear solution is used for 
the above estimation and approximation solution as initial values it will 
be possible to carry out estimates with high accuracy and high speed. 


With regard to lists of variables, observation equations, initial values, 
etc., for initiating the nonlinear least squares methods, if a pattern 
obtained by matching patterns can be solved with a user’s solution routine, 
the user’s solution routine will be initiated. Finally, results obtained 
by starting the routine will be transferred to the nonlinear solution. 


10. Specified Accuracy 


It is difficult to briefly mention the measurement accuracy, since it varies 
depending on the object of measurement, the method of selecting the vertex 
and straight line, and specific variables involved. However, in individual 
cases, the measurement accuracy can be estimated from observation equations 
and observation noise. Assuming that the parameter which should be 
specified is x, and the observed value is y, the observation equation is 


y = h(x) 


H is the Jacobian matrix,the covariance matrix of observation error is zy, 
and the error covariance matrix of the parameters is 


3 4* (Hx? H)~? 


The observation error is not always expressed in normal distribution since, 
in this system, measurements are carried out by humans. Also, the 
distribution of errors changes depending on the situation, and it is 
necessary to be attentive to this change. 


ll. Image Measurement by Monocular Vision 


The shape, attitude, and position of models are estimated from an image in 
this system. It is difficult to find both the shape and absolute distance, 
since measurements by monocular images bring only a small amount of 
information. However, in the following relatively useful case, it is 
possible to carry out measurements. 


When objects with known shapes are used, and when the number of points 
coordinated between the interior of the model and the image is more than 
three, the three-dimensional attitude and position of these objects can be 
measured.’ Inversely, when the shape of the objects is known and when the 
position of these objects is known, the three-dimensional attitude and 
position of the objects can be estimated. Measuring the initial state of 
locomotion robots is relatively complex, but the state of these locomotion 
robots can be readily estimated by measuring using images. 
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Even if the objects are rectangles and their dimensions are unknown, the 
attitude and aspect ratio can be estimated by observing four points. 
However, the absolute distance and dimensions cannot be solved. Also, if 
either the longitudinal dimension or lateral dimension can be solved, the 
remaining dimension and the position can be measured. 


It is permissible to assume that the robot is on a flat plane in 
environments in which the motion of robots can be specified on two- 
dimensional flat planes, such as inside factories. Im this case, a total 
of variables should be estimated since the position has two degrees of 
freedom and the attitude has one degree of freedom. The position and the 
attitude can be estimated by observing two points. 


12. Experimental Results 


Here, estimation results will be described for some examples. The estimates 
have becn carried out using this system, and the input images and models 
overlap. 


(1) Example 1 


Figure 10 [not reproduced] shows the results of estimating the position and 
attitude of a desk. Six vertices were coordinated. The estimated error of 
the attitude was an RSS error, and was 2.4 degrees. The positional error 
has not been measured. 


(2) Example 2 


Figure 11 [not reproduced] shows the results of estimating the three- 
dimensional position and attitude of a locomotive robot. The vertical line 
of the wall and the horizontal line of the illumination were coordinated. 
The attitudinal error was an RSS error, and was 3.2 degrees. The positional 
error was 12.5 cm. 


(3) Example 3 


Figure 12 [not reproduced) shows the results obtained by using a human 
modzi, by estimating the articulation angle as a variable, and by 
overlapping the human model and an image. The total number of variables was 
estimated to be 25 by adding the 19 variables showing the articulation angle 
to the 6 variables indicating the position and attitude of the body. 


13. Conclusion 


The nonlinear least squares method requires much time since the expression 
of the system uses the Lisp function. We are currently carrying out a study 
in which the Lisp function is turned into a c function, since the c function 
can be called from the Lisp function. We are also conducting a project in 
which observation models can be output as c functions by processing these 
observation models. 
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The system is currently being used to carry out measurements from an image, 
but image measurements by monocular vision involve many restrictions. It 
is particularly difficult to measure objects with unknown shapes. However, 
it is necessary for the system to be able to measure objects with unknown 
shapes. If the system is equipped with a distant sensor it will be easy to 
estimate shapes, and it is believed that the system employing a distant 
sensor will take a step forward toward practical use. 


Restricted conditions are currently handled with a penalty method, but the 
use of the penalty method may cause numerically unstable states to occur. 
This method will be modified in the future. 


This system can also be used as a system to recognize images. 
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[Article by Youji Umetani and Kazuya Yoshida, Tokyo Institute of Technology) 
{Text}) 1. Introduction 


The age of full-scale space development has arrived, and space robot 
technologies are in the limelight. It has been pointed out that 
technologies for robots and automation will have to constitute the main keys 
to relieve workers (astronauts) from dangerous labor called for in the 
extreme environment of "Space," and to promote the effective use of space 
while raising the working efficiency.'* Specifically, the unmanned 
satellite system with an autonomous manipulator can be regarded as an 
intelligent locomotion robot which can freely fly in space, and the 
importance of research and development of such space-related intelligent 
locomotion robots is very high. 


The conceptual study of robot systems for use in space environments was 
started in the 1970s in the United States,’ and such a robot system was first 
put to practical use as a manipulator system in the Space Shuttle.‘ Since 
then, other countries have conducted research on space robot manipulators, 
with Japan also promoting the basic research and development of space 
station manipulators’ and orbital servicing vehicles [OSVs]. Specifically, 
the latter functions as an intelligent iocomotion robot for use in space, 
as mentioned above, and is very interesting. 


Incidentally, it is necessary to be on the alert for new problems that could 
be caused by the difference between environmental conditions on the ground 
and those in space when conducting the research and development of space 
robots. In general, orbital environments have 1) a substantial vacuun, 

2) severe thermal conditions, and 3) minute gravity. Many technical 
subjects must be solved, since problems peculiar to each condition will 
occur. Of the three items above, the following two problems caused by item 
3) are important from the standpoint of robot control. 


(1) It will become possible to manufacture huge structures since they will 
not need to support their dead loads in minute gravity environments. Also, 
these structures are designed so that they will be significantly lightened 


/ 
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when their rockets are launched due to the weight limit. As a result, large 
robot arms and large structures, such as space stations, will essentially 
become flexible structures with low rigidity and will require damping 
control. 


(2) Am immovable foundation, which should become a stan¢=rd, cannot be 
obtained since all objects are in a floating state while orbiting. That is, 
the rotation of the manipulator arms will cause a reaction that will move 
the foundations fixing these arms. For example, when a manipulator is 
mounted on a satellite, the attitude movement of the satellite itself will 
be disturbed by the movement of the manipulator. 


Of the above two problems, research on the first is being vigorously 
conducted in various fields, while this paper tackles the second problem and 
describes detailed movement control of rigid body manipulator systems in 
orbit. 


The accurate operation of manipulators is interrupted by the reaction to the 
spaceship bases caused by the movement of these manipulators. This matter 
is not as serious when astronauts carry out work on the relative coordinate 
systems fixed on spaceships, but when an object in orbit, such as that shown 
in Figure 1, is caught, it is necessary to operate a manipulator along the 
target orbit described on the inertial coordinate system fixed in space. 
In this case, it is necessary to be able to control manipulators due to the 
reaction caused by spaceships. 


Research on the modeling of some space manipulators has been conducted in 
the past’”® and, as shown in Figure 1, when capturing objects is considered, 
it is necessary to solve an inverse kinematic problem involving floating 
rigid body systems. The authors, have paid attention to this problem, have 
formulated the kinematics of space manipulators installed on floating 
satellites, and have proposed a new kinematic theory for space manipulators 
in which reaction dynamics is taken into consideration. The basic 
philosophy of the new theory has already been described in the references 
mentioned later in items 1) and 2). Now, the authors will describe the 
detailed process of deducing the n-w theory, show a simulated result of a 
model of a certain robot satellite, and study problems involved in catching 
and controlling orbiting objec~s and in controlling spaceship attitude. 


2. Formulation of Problems 
2.1 Description of Problems 


This paper tackles the task of catching a floating target, as shown in 
Figure 1, as important for space robots. In order to execute the catching 
motion, it is necessary to give a target or bit as a tool to the catching 
motion and to find the articulation motion necessary to realize the catching 
motion, i.e., it is necessary to solve so-called reverse problems. It is 
very interesting to solve them analytically. 


Incidentally, if tne position and attitude of satellites can be controlled 
in orbiting satellite manipulator systems so that these satellites are fixed 
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Figure 1. Schematic Illustration of a Capture Operation in Orbit 


completely in inertial space, manipulators mounted on the satellites can be 
handled similarly to those fixed on the ground. One method is to study the 
control of the position and attitude of such satellites, but the authors 
think that this is a dynamically special case. In this paper, the authors 
believe that a general case would involve interference being generated 
between both motions without any satellite control, the entire satellite- 
manipulator system being formulated by regarding it as an articulated rigid 
body link system floating in space, and a solution to general reverse 
problems being studied. 


2.2 Assumptions 
The following assumptions have been made to clarify points of discussion. 


(1) A robot satellite is mounted with a rotating articulated manipulator 
having n degrees of freedom. Also, all systems consist of rigid bodies. 


(2) The systems are floating in inertial space, and the dynamic 
conservation law holds without any external force reacting. Also, the 
position and attitude of the satellite itself are not controlled. 


(3) All states of the systems are observable, and the capture orbit 
necessary to solve reverse problems is given to inertial space in advance. 


2.3 Establishment of Model and Variables, and Coordinate System 


The model and variables are established as shown in Figure 2. The main 
variables are as follows: 


x, : Barycentric position vector at each articulation 
i : Barycentric position vector of the entire system 
fn : Position vector at the top of manipulator 


f£,, &, Bj: Vectors which show length of each articulation and 
barycentric position 
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m, : Mass of each articulation 
I, : Inertial matrix around barycenter of each articulation 
@, : Rotation angular velocity around barycenter of each 
articulation 
a, 8, y: Attitude angles (yaw angle, pitch angle, and roll angle) 
of satellite itself 
¢, : Rotation angle of each articulation 


(where i- O0-~n, j=1-n) 


Satellite Main Body 








Inertial Coordinate System 


Figure 2. Model of Robot Satellite Installed With an 
Articulated Manipulator 


Also, the inertial coordinate system, which will become a standard, is 
expressed by £,, and a relative coordinate system fixed on each articulation 
is assumed to be £,. Vectors and matrices are expressed by Z, (inertial 
system) unless otherwise specified. When they are indicated on relative 
coordinate systems, a superscript letter will be attached to their left, 
e.g., *@ (vector a, is expressed by the £, system). Also, transformation 
matrices convert vectors expressed by the system into inertial systems. 
These transformation matrices have been determined to be A (3 x 3 tensor). 


3. Kinematics of Space Manipulators in Which Reaction Dynamics Are Studied 
3.1 Basic Equations 


When the attitude of a satellite is not controlled, a robot satellite system 
whose manipulator consists of n articulation links can be regarded as an n 
+ 1 articulated series rigid body system floating in agravic space. Here, 
the basic kinematics of this articulated rigid body link system will be 
explained, and finally, a generalized Jacobian matrix of floating rigid body 
link systems will be deduced. 


Generally, the basic equations of the assumed link systems can be described 
as follows: 
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[Definition of barycentric position of the entire systen) 


Par ri 25 (1) 


{Translational li-»-ar momentum conservation law] 


Fm rs (2) 
[Angular momentum conservation law] 
EE iwc tmirixes) seo. (3) 
[Geometric joint condition of articulations] 
Pi-Pi-n*eit+bi-s (4) 
[Character!*tic equation of manipulator] 
(5) 


a 
Fere +be +Eae 


Items (1) and (4) are simultaneous equations concerning barycentric position 
vector g, at each articulation. The following equation can thus be obtained: 


—22 CAIAA +re (6) 


where, coefficient K,, is a function of the mass ratio of each articulation. 
By differentiating equation (6) with respect to time, ©, can eventually be 
solved as follows: 


. a . 
Fi*ZvustestVe 


Also, V, is the initial velocity of the systvms gravity, and is constant as 
long as external force does not act on the systems. 


On the other hand, angular velocity «, around the gravity of each 
articulation can be expressed by a figure like that shown in Figure 2 on the 
basis of a simple geometric relationship: 


eZ (Ay — $s tee 
ont * 


where, 0, is a unit vector which shows the axis of rotation of the jth 
articulation, and @, is the initial angular velocity of the entire systes 
around the system gravity. 
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As mentioned previously, both ¢, and m, can be expressed by a linear 
combination using angular velocity yi of the articulations. 


3.2 Characteristic Equation of Manipulator 


Generally, the characteristic equation of conventional manipulators can be 
expressed as follows: 


P=1 (6) (9) 
where P= (pat. On *)* 

O= (63. On... On)? 

6a : 


As is well known, the above relationship is linear, and its solution depends 
greatly on the state of the manipulators. The relationship obtained by 
differentiating equation (9) is as follows: 


P=3 (66 (10) 


However, im equation (10), the angular velocity ⸗ of the articulations and 
velocity @ in hand can be described by a simple algebraical relationship by 
using the Jacobian matrix, J(6)=8f786@ . The angular velocity of the 
articulations of manipulators can be found against the velocity target value 
given in the working space based on equation (10). This method is known as 
a resolved motion rate control [RMRC]. It is also known that Jacobian 
matrices which appear in the method play an important role in analyses of 
the mechanism and operational properties of materials. Then, the kinematics 
of space manipulators is analyzed based on the RMRC philosophy. 


Differentiating equation (5) with respect to time gives the following 
equation: 


. — an 
Pere +& (Ao *be) + Ea tat a4) (11) 


Jacobian matrices of conventional ground manipulators can be obtained 
immediately from the third term of the above equation, but a term concerning 
the attitude angular velocity and barycentric velocity of a satellite itself 
is added to the above equation. Also, the satellite itself is a manipulator 
installation foundation. These terms can be readily deduced as linear 
functions of ¢ from equations (7) and (8), and the entire right side of 
equation (11) can be expressed by a linear combination of 


é=<, 3. 5 28 $s. ‘* a 
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where, Pe= (vet. @wet)* 


K,,, used in equation (6), is used to deduce equation (12). That is, a new 
Jacobian matrix 3 , defined in equation (12), is a function of the mass 
ratio of each link, and essentially satisfies the geometric condition, 
equation (1), concerning the barycentric position of the entire systen. 
Also, equation (12) cam be described as follows by dividing it into the 
satellite section and manipulator section: 


Pads bs +Jn dn +Ps 

Jo (ext eatriz) , Jn (om estrix) , 
és= (ae, #, r)t, 

On = (@5. @a~@a)?F 


3.3 Conservation Law of Linear Momentus 


Equation (13) is a basic uxpression important for describing the kinematics 
of floating rigid body link systems, and gives only n-degree independent 
equations against variables of bs (3 degrees), é. (mn degrees): n + 3 degrees 
totel. The motion of each articulation is restricted by « mutual reacting 
fo im floating rigid body systems on which external force does not act, 
and p, and 4, cannot be determined independently. In order to describe the 
relationship between them, it is necessary to consider the dynamics of the 
entire systems. 


It is generally the case that the balance between force and torque is 
described to study dynamics, but this case becomes very complex. 
Incidentally, paying attention to the fact that the momentum of entire 
systems is conserved in those on which external force does not act, it will 
become possible to make arguments at dimensions of inertial term + velocity 
(angular velocity) = momentum (angular momentum), and it will become very 
easy to formulate the above msomentun. 


Arranging equations (2) and (3) by using the relationship between equations 


(7) and (8), the conservation of momentum can be summarized eventually, as 
shown in the following equation: 


Ue ft te lem te 


-—?* 
f 








(14) 
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Inertial term &¢, which appears in the above equation is obtained by 
projecting the intensity of inertia against rotation ¢, in the 
coordinate space. Similarly to equation (12), equation (14) can be obtained 
by combining the satellite section and manipulator section, and is shown as 
follows: 

Ta be +In dn @Ls (15) 
where, 


Le (S21 vector) <= initiol angular ecnestes 
Is (as3 eotria) . Zn (tm setriz) 


3.4 Generalized Jacobian Matrix of Floating Rigid Body Link Systes 


Two important basic expressions, (13) and (15), were obtained from the 
above-mentioned theories. They are simultaneous linear equations with three 
unknowns involving the n + 3 variables bs be. Incidentally, in order for 
the kinematics of manipulators to be achieved, it is necessary to explain 
the relat ip between working space variable P and arti tion space 


variable ¢,. Now, solving equation (15) with respect to gives the 
following equation: 
bs *- Zen dnt Ie Le (16) 


Substituting this equation for equation (13), the following equation can be 
obtained: 


P= (Jn-Js Te*In) bn +P (17) 


where, constant term, Pe+dsZe"Le is newly set as P,. 


Equation (17) describes the relationship between the articulation space and 
working space of floating multibody link systems, and implicitly includes 
the influence of the reacting motion on satellite sections. The intensity 
of the influence is shown with equation (17), with JeZe'In and K,, used 
when each term is deduced. For example, when the inertia of the satellite 
sections is very large, the following equation will be obtained: 


IeIn 0. Jud 


That is, equation (17) will be changed to P=J3én, and will become the same 
equation as the kinematic equation for ground manipulators. This matter can 
probably be understood clearly by regarding the ground manipulator as a link 
system fixed on a large foundation, “Earth,* which has an extremely large 
mass. 


That is, it can be said that equation (17) is a general expression for the 
kinematics of floating rigid body link systems, including conventional 
manipulators fixed on the ground. Then, rearranging the term in equation 
(17) in parentheses, calling it the “Generalized Jacobien Matrix of Floating 
Rigid Body Link Systems," and presenting it with J’, we obtain the following 


equation: 
Paz*d, +P, (18) 
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When there is no redundancy be.xiin the working space and articulation 
space, J” will be changed to a square matrix of n x n, inverse matrices will 
be found in points other than singular points, and the inverse 
transformation of equation (18) will be given as shown in equation (19): 


bn = (2*)-* (P-B,) (19) 


Inverse kinematic problems can be found analytically, regardless of the 
existence or lack of a reacting motion of the satellite sections. This 
matter provides an important element to the sotion control of space 
manipulators. 


4. Study of Acquisition Control Probleus 


At this point, acquisition control problems will be studied by computer- 
simulating a model of a robot satellite assuming the above-mentioned 
formulated equations. 


Basically, three degrees of freedom have been selected for the manipulator, 
while three degrees of freedom for the wrists have been omitted for the sake 
of simplicity. The values shown in Table 1 are supposed as the 
specifications of a realistic robot satellite. If the sanipulator is 
operated along an orbit supposed arbitrarily from the certain initial 
posture shown in Figure 3(a), the speed in hand along the operation orbit 
at this time can be given as shown in Figure 3(b). 


Table 1. Specification of the Systes 





























Satellite Manipulator 
link 0 link 1 link 2 link 3 
mass (kg) 2,000.0 20.0 50.0 50.0 
{ (a) 3.5 0.25 2.5 2.5 
3x (kgn*) 1,400.0 0.10 0.25 0.25 
Ly (kgm) 1,400.0 0.10 10.4 10.4 
Tz (kgm) 2,040.0 0.10 10.4 10.4 
s * 
Initial —E 
Posture ‘ 
= J 
Target Point sa*' 
Capture Trajectory i “sas ~ ae ee 
time ( sec ) 
Figure 3(a). Figure 3(b). Motion Rate of the Tip 
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4.1 Case When Satellite Itself Is Not Controlled 


First, the following case is studied. In this case, the satellite is 
engaged in reacting motion since it exerts no control over its position or 
attitude. Figure 4(a) and (b) show results of solving reverse problems by 
using equation (19). As is clearly shown in these drawings, the reacting 
motion of the satellite is unexpectedly large. The attitude is changed by 
about -23 degrees around the roli axis end about 14 degrees around the pitch 
axis during the assumed manipulator operation, with translational motion 
generated simultaneously during this operation. However, it can be 
appreciated that the top of the manipulator’s hand catches the target orbit 
precisely, in spite of the reacting motion generated from this foundation. 


The final position and attitude of the satellite itse\f due to reacting 
motion depend on the course followed by the top of the manipulator’s hand. 
Also, when the satellite is in metion following the identical course, the 
identical results will +s obtained regardless of the motion speed. That is, 
it is necessary to keep in mind that however slowly the manipulator may be 
operated, the change of the position and attitude due to the reacting motion 
is inevitable. 








ate2.0 (sec) 


attitude angle 











x Y 
Figure 4(a). Course of Posture Figure 4(b). Rotational Motion of 
Change (Free-Flying Satellite Main Body 
Case) 


4.2 Attitude Control Problems 


Next, the following case is studied. In this case, the attitude of the 
satellite itself is controlled during the operation of the manipulator. At 
first the formula mentioned in Chapter 3 was promoted on the assumption that 
the satellite itself was not controlled, but it is possible to simply apply 
the formula to an attitude control problen. 


This problem can be treated as a case in which the angular morentum of the 
satellite side is controlled arbitrarily by mounting a reaction wheel on the 
main body of the satellite. Rearranging equation (15) on the assumption 
that {, is the reaction momentum which should be added to the satellite to 
control its attitude, we have the following equation. 


Is $0 +In én +Le 1 * (20) 
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Momentum {., which should be added to the satellite during manipulator 
operation, can be found by simultaneously realizing equations (20) and (13) 
and by substituting $6, = 0 (settitude change of satellite = 9) for the 
simultaneous equation. 


Le=-InJn-* (-P, ) (22) 


Also, the inverse kinematics of the manipulator at this time can be found 
using equation (22) by substituting g, = 0 for equation (13): 


ae 
e: [Jn ~! (P-P,) (22) 


Figure 5 shows the results of solving the previously-mentioned acquisition 
control problem by using two equations, (21) and (22). Figure 5(a) shows 
the motior of the entire system at this time. The attitude of the satellite 
is fixed, but transitional motion occurs. Figure 5(b) shows the reacting 
angular moscatum calculated with equation (21). Figure 5(c)shows the 
results obtained by differentiating the reacting anguler somentun with 
respect to time and by finding it as a control torque. Performances 
required of the reaction wheels to be mounted on the satellite can be 
confirmed by studying such simulations. 





—— 


Figure 5(a). Course of Postural Change (Attitude Control Case) 








Figure 5(b). Required Counter Momentum 
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2.8 3.0 —X a. 
(e) time ( sec ) 


Figure 5(c). Required Counter Torque 





5. Conclusion 


In this paper, the solution to inversely kinematic problems was deduced 
analytically by modeling a satellite system, on which a manipulator was 
mounted, as a rigid body link system floating in inertial space. 


The acquisition problem of floating targets was taken up as an example of 
a typical inverse problem involving space materials, and the usefulness of 
the methods proposed was shown through computer-sisulations. 


The reacting motion generated in the satellite is shown through simulations 
in which a realistic model is assumed. It has been confirmed that this 
reacting motion is of such magnitude that it cannot be ignored, and a very 
large capacity reaction wheel is required to control the reacting motion. 
The manipulator is controlled purposely while allowing the reacting motion 
mentioned in the paper. Therefore, it can be assumed that the manipulator 
controlling method is very effective for the case when the controlling 
capacity at the satellite sido is limited. 


Also, the magnitude of the influence of the reaction depends on the 
operating orbit of the manipulator, and one of the subjects of future 
research will be to study the operating orbit that will minimize this 
influence. 
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Development of Intelligent Robot for Nuclear Power Station 


43064062 Tokyo 4TH INTELLIGENT ROBOTS SYMPOSIUM PAPERS in Japanese 
13/14 Jun 88 No 112 pp 127-132 


[Article by Ryouichi Nakayama, Katsuhiko Satoh, Satoshi Okada, Kazuhiro 
Tsumura, Hisashi Hozeki, Katsumi Kubo, and Akira Abe, Toshiba Corporation] 


[Text] 1. Introduction 


In recent years, the importance of nuclear power plants has increased as 
fundamental electric power generating facilities for the stable supply of 
electric power. For this reason, the maintenance of nuclear power plants 
has become important in stably supplying electric power. Since the 1970's, 
the introduction of automatic machines and robots has been promoted as a 
labor-saving measure for workers, minimizing the exposure of workers to 
radioactivity, etc., since equipment necessary to ensure a stable supply is 
diverse, including such things as pumps, valves, tanks, etc.’ The 
development of locomotion robots to inspect and monitor has been vigorously 
conducted, particularly since March 1979 when the accident occurred at Three 
Mile Island Nuclear Power Plant (TMI-2) in the United States. In Japan, the 
"Development of a Nuclear Power Generation Supporting System" was carried 
out as a complementary task promoted by MITI for 5 years beginning in 

FY 1980, and inspection robots for nuclear power plants were developed.*‘ 
The development of robots to be engaged in extremely dangerous environments, 
which is a large project promoted by the Agency of Industrial Science and 
Technology [AIST], has been carried out since FY 1983 in order to develop 
working robots capable of offering higher functions and intelligence. The 
purpose has been more closely defined since the interim evaluation which was 
carried out last fiscal year.** 


In addition to the above-mentioned projects, private corporations, such as 
electric power companies and nuclear power plant manufacturers, have been 
developing inspection robots for practical use in nuclear fields to 
minimize the exposure of workers to radioactivity and to save more labor 
than ever before. Two subjects have been promoted in most of these 
projects. One is to develop mechanisms to make such robots carry out the 
locomotion and work smoothly, while the other is to develop autonomous 
control systems, enabling these robots to have higher intelligence as it 
relates to their work and behavior. 
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The manuscript describes the “Intelligent Working Robot," which is an 
autonomous working robot with relatively high intelligence which can replace 
workers in carrying out simple work, and is one of the r.bots for nuclear 
power use which has been developed by the authors. 


2. Trends Involving Development of Robots for Nuclear Power Use 


Working robots for nuclear power use must be capable of the following 
functions in order to carry out work while steadily locomoting in nuclear 
power plants. 


(1) They must possess a multifunction corresponding to nonroutine and 
complex work. 


(2) They must possess high functions for environmental recognition and 
intellectualization.*”* 


(3) They must be resistant to severe environments. 


Various working robots for nuclear power are being developed to achieve the 
above-mentioned functions. 


The authors developed a system-maintaining robot, called “AMOOTY,” as a 
locomotion working robot in FY 1983 in collaboration with a group consisting 
of Professor Yoshikawa, et al., of the Department of Precision Machinery 
Engineering, Faculty of Engineering, the University of Tokyo.':*:’~® 


This AMOOTY is a maintenance working robot which can take over for humans 
in carrying out inspection and simple maintenance work. It consists of a 
traveling section with clover-type wheels, a manipulator with nine degrees 
of freedom of movement, a visual section consisting of laser beams and a 
television camera, and a system to control them completely. 


The Advanced Intelligent Maintenance Robot System [AIMARS], which is an 
intelligent working robot, has been newly developei by fully utilizing the 
results of further raising the functions of the system maintaining robot and 
of studying various improvements, with the aim of putting the system 
maintaining robot to practical use.*»*™ 


This manuscript describes the outline of the new robot system and test 
results. 


3. System Configuration of Intelligent Working Robot 


The system configuration of the intelligent working robot [AIMARS] is 
similar to that of humans. Similarly to humans, the AIMARS consists of a 
traveling section, manipulator, visual section, image processing unit, 
comprehensive controlling section, operating input system, and indicating 
device. The traveling section is equivalent to legs which can be used to 
locomote the floor, weir, and stairs, the manipulator is equivalent to arms 
and hands which repair equipment, the visual section is equivalent to eyes, 
the image processing unit processes images and measures and recognizes the 
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position of the robot in relation to the environment, the comprehensive 
controlling section controls the other sections and is equivalent to the 
brain, the operating input system remotely controls the robot, and the 
indicating device can indicate the states of the robot so that operators can 
readily recognize these states. 


1 shows a system block diagram of the AIMARS, while Figure 2 [not 
reproduced) is a photograph of the exterior appearance of the AIMARS. 








working rebet | 
Figure 1. System Block Diagram of Intelligent Working Robot [AIMARS} 


The AIMARS has been developed so chat it can be put to practical use as a 
working robot, while keeping in mind the following three items gained 
through the experience of the previously mentioned AMOOTY. 


(1) A compact and lightweight traveling section, combined with an increase 
in turning controllability. 


(2) Am increase in autonomous traveling performance resulting from 
combining various sensors, such as visual sensor and ultrasonic sensor. 


(3) Am increase in the remote controllability of the manipulator. 
3.1 Traveling Section 


A special mechanism has been adopted in the traveling section so that the 
robot can smoothly travel weirs and stairs by using its wheels without any 
decrease occurring in its traveling speed. This mechanism is termed a 
"Clover-Type Wheel," which was already devised and applied to the AMOOTY. 
This wheel consists of three small wheels and an arm connecting them. When 
traveling on the floor, the robot rotates on its axis when two small wheels 
come into contact with the floor, and when traveling weirs and stairs, it 
uses a small wheel and the rotation of the arm. Figure 3 shows the robot 
negotiating the stairs while using its clover-type wheel. 


Also, a three-wheel structure has been developed and adopted in the new 


robot to raise the turning controllability. This structure has a motor 
driven steering mechanism at the front wheel, and is shown in Figure 4. 





Figure 3. State of Robot Negotiating Stairs 


wes g 
ae we 
AS, 


3,4: 2 aetere for ere retetion 
S: 1 steering acter 


Figure 4. Configuration of Traveling Section 














As a result of the above-mentioned development and adoption, the number of 
traveling driven mechanisms has decreased from eight to five, along with the 
new robot becoming compact and lightweight. A gear transmitting mechanisa 
was previously used as a wheel rotating anc driving system in a section, but 
a chain transmitting system has replaced the gear transmitting mechanisa, 
further miniaturizing and lightening the robot. In addition, high tensile 
strength aluminum is being used in the arm of the clover-type wheel. As a 
result, it has become possible to reduce the weight and volume to about 50 
and 60 percent, respectively, of those of the traveling section of the 
AMOOTY . 


Table 1 shows the relationship between the weight and dimensions of the 
traveling section of the AMOOTY and those of the AIMARS. 


Methods of controlling the traveling section will be described later. 


3.2 Manipulator 


The manipulator consists of a slave manipulator mounted on the robot and a 
master manipulator remotely controlled by an operator. 
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Table 1. Comparison Between Trawling Section of Intelligent Working Robot 
and That of System Maintaining Robot (AMOOTY) 











Iten Intelligent AMOOTY 
working robot 
Total weight 220 kg (160 kg) 360 kg (300 kg) 
(Weight of traveling section) 
Overall length 1,650 om 1,609 om 
Overall height 700 om 1,187 oo 
Overall width 700 om 740 om 
Traveling performance 
Turning radius 1,000 om 600 om 
Stairs 30°, 150 a 35°, 220 om 
Speed 1 ka/hour 0.54 km/hour 
Weight on board About 100 kg About 60 kg 





The slave manipulator must be lightweight because it is mounted on the 
previously-mentioned traveling section. On the other hand, in order to 
carry out nonroutine and complex work, it is preferable that the robot have 
much freedom of movement and many articulations. It was decided that 
lightweight materials (for example, carbon fiber glass reinforced plastics 
[CFRP] is used in the external cylinder of the arm) would be used for the 
former, while the degree of freedom would be determined for the latter by 
analyzing the distribution of degrees of optimum freedom in order to satisfy 
the above contradictory conditions. As a result of studying this matter, 
it has become possible to realize a manipulator with 9 degrees of freedom 
of movement, an overall length of about 1.7 a, and a dead load of about 

61 kg. Figure 5 shows a block diagram of a manipulator consisting of an arm 
with 9 degrees of freedom of movement and four articulations, and a hand 
equipped with a force sensor. This manipulator employs a distribution 
system in which each articulation is equipped with a motor and a power 
transmitting mechanism (gear, etc.). Also, three kinds of controlling 
methods (mentioned later) are combined for the manipulator. 


In addition, a microminiature charge coupled device (CCD) color camera is 
installed in the hand so that more detailed information on work targets can 
be given to an operator. Due to such information, the operator progress 
will increase. Figure 6 [not reproduced] illustrates a slave manipulator 
and a microminiature color CCD camera™ installed on the hand. Figure 7 [not 
reproduced] illustrates a master manipulator. This master manipulator is 
of a modified type, and has a scale of about two-thirds that of the slave 
manipulator. 

















Figure 5. 
3.3 Sensor Section and Control Section 


Both manipulation control and traveling control, the main forms of 
comprehensive control, are generalized for this intelligent working robot 
so that various sensors can be combined and used with each other. The 
visual sensor for use in understanding environments, the ultrasonic sensor 
used mainly when the robot is traveling, the tilt angle gauge, etc., can be 
cited as some of the above various sensors. Figure 8 shows a block diagrans 
of the robot's control system, and Table 2 shows specifications and the main 
uses of various sensors. 








Indicater and image 
precessing unit 

















Operation 
input systese 


—— — 
Figure 8. Block Diagram of Control System of Intelligent 
Working Robot 


Information for main control is input as images of the target and travel 
paths in an image processing unit [TOSPIX-II]) by using a visual sensor. The 


object is recognized by processing the information, and the results of 
measuring the distance between the object and the robot is used. 

















Table 2. Sensors for Robot Traveling 





Other sensors 





Use Visual sensor Internal sensor External sensor 
For autonomous eMicrominiature CCD eTraveling dis- eUltrasonic 
traveling of color TV camera tance detecting sensor 
robot sensor 
eGyroscope 
eStereoscopic TV Steering angle 
camera for dis- detecting sensor e*Tilt angle 
tance measurement sensor 
eArm angle detect - 
ing sensor Photoelectric 
sensor 





(1) Comprehensive Control 


The integrated control section comprehensively controls the entire systen, 
makes plans for robot behavior based on the processing results obtained fros 
the image processing unit, outputs operation commands for the traveling- 
section/universal head controller and a slave controller for manipulators, 
obtains operating states of the robot from each controller, and outputs 
these operating states to a display screen preparation unit. In addition 
to this integrated control system, the robot has operation input systems, 
such as an operation mode switch, joystick witch use# to input data 
manually, etc. These operation input systems will be described in the next 


paragraph. 
(2) Traveling Control 


The autonomous traveling control perceives paths, walls, etc., with a visual 
sensor in accordance with the control flow shown in Figure 9, the 
information perceived with the visual sensor is processed with an image 
processing unit, TOSPIX-il, and the traveling section is autonomously 
induced by combining the results obtained by processing this information 
with information on the traveling path (map) submitted in advance. The 
control of the traveling section is broadly classified into two kinds, i.e., 
flat traveling control and stair traveling control. 


¢ Flat Traveling Control 


When the robot travels on a straight section, it will detect a white 
line, which expresses the width of a path, with its microminiature CCD 
color camera, and will calculate the difference between the center of 
the robot and that of the path. That is, in such cases, it will 
autonomously travel on the path by using the algorithm. Figure 10 
[mot reproduced) shows an image example for the case in which the 
robot travels on a straight line processed with an image processing 
unit while catching a path, with a camera installed on the hand of the 
previously-mentioned manipulator. 
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Figure 9. Flowchart of Autonomous Traveling Control 


Also, when the robot traverses corners and negotia’ses stairs, visual 
information is combined with other informatio... obtained from an 
ultrasonic sensor and a gyroscope. As a result, autonomous traveling 
control with higher reliability has been realized. 


¢ Stair Traveling Control 


As shown in Figure 3, the ascending and descending of stairs has been 
realized with an arm angle detecting sensor of the clover-type wheel 


and a tilt angle sensor of the robot and by adjusting and controlling 
the front and rear wheels. 


(3) Menipuletor Control 


The following control system was adopted as a manipulator control. A work 
target is caught with two visual sensors, the distance between the robot and 


the object is measured by processing images of the object, and the 
manipulator is placed close to the object based on this distance-related 
data. 


It was decided that an operator would remotely control the robot so that the 
robot could carry out complex and minute work, such as the final application 
of tools to an object, etc. For this reason, bi‘ateral control has been 
realized, raising remote controllability, by installing a strain gauge and 
a force sensor on each section of the manipulator. The force sensor senses 
the gripping of an object, and transmits this sense to an operator. 


As shown below, the saripulator control is classified into modes. 
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Autonomous mode: Images sent from a visual sensor (stereoscopic TV camera 
for measuring distance) are processed with an image processing unit, the 
coordinates of an object are found, and the manipulator is transferred in 
fromt of the object based on the results of the above processing and 


findings. (CP control) 


Automatic mode: When there is no change in the relationship between the 
relative position of an object and that of the robot, even when the robot 
travels on a road, etc., (for example, tools on the robot), a task is 
instructed to the robot in advance, and the instruction is regenerated as 


necessary. (Teaching playback control) 


Remote mode: An operator controls the master sanipulator while sonitoring 
the robot by using a TV camera for manipulators on the operation table and 
a@ stereoscopic TV camera, and makes the robot carry out work while driving 
the slave manipulator. (Master slave control) 


The autonczous and automatic control of the manipulator with 9 degrees of 
freedoms of movement is divided into 3 degrees of freedom ($1, R2, P3) at 
the base side and 6 (R4, 75, P6, R7, PB, and R9) at the arm side, a robot 
controller is installed in each side, mutual timing is secured, and the base 
and arm are driven simultaneously. The use of this method enables an 
operator to reduce the time involved and to make the robot carry out work 
smoothly. Figur. 11 shows the autonomous control flow of the manipulator’s 
work. 


Top coordinate at the base side is calculated fros 
coordinate values of an object obtained at the con- 
prehensive control section by using an image 
processing unit. 

4 


Top coordinate value at the base side and coordinate 
values of the object are transmitted to the base and 
ara controller. 

4 


Starting commands are sent, and base and arm are 
driven simultaneously. 


Figure 11. Flowchart of Autonomous Control of Manipulator 
3.4 Operation Input System and Indicator 


This robot is designed so that simple work is autonomously or automatically 
controlled and complex work is remotely controlled by an operator on the 
basis of the operator's judgments. Therefore, the robot is configured so 
that the operator can readily handle the operation input system and 
indicator, and easily understood information is transmitted to the operator. 














Three joystick switches are adopted in the remote controlled operation input 
system of the traveling section, and a master manipulator is used for 
manipulative work. 


Figure 12 [mot reproduced) shows the exterior of the operation input systes 
and that of the sanipulator. Even en operator can conduct operation inpu* 
work. This operation input system is equipped with an image indicating 
section for a microminiatury CCD color stereoscopic TV camera mounted on the 
robot so that the cperator can handle the manipulator while watching images. 
In addition, a three-dimensional color graphic indicator is adopted in the 
system to clearly transmit states of the rebot to the operator. This 
indicator shows such states as three-dimensional animations at real time. 
Figure 13 [mot reproduced] shows an example of a three-dimensional animation 
indicated by combining the tested unit and the robot. 


4. System Test and Result 


The tester shown in Figure 14 was made, and tests of the following two items 
were conducted to grasp the performance of the intelligent working robot we 
developed: 


1) Autonomous traveling test 
2) Manipulation test 


(1) Autonomous Traveling Test 


A traveling test was conducted on a traveling path with an overall length 
of about 14 a, as shown in Figure 14. It was confirmed that the robot could 
autonomously travel on the traveling sections, such as straight sections, 
corners, and stairs (tilt angle of 30 degrees and step height of 150 m=), 
in accordance with the control flow shown in Figure 9, by combining such 
sensors as visual sensors, ultrasonic sensors, gyroscopes, and tilt angle 
gauges. Also, no problems occurred when handling a flange bolt of a tank 
after the robot stopped at the end point of a traveling section because the 
stop position accuracy of the robot was very high. 


(2) Manipulation Test 


It was confirmed that the operator could remotely control the work involved 
in increasingly tightening the flange bolt (M 24) about 1 m in front of the 
end point from the master manipulator by using a ratchet-type tool, as shown 
in Figure 15 [not reproduced], while watching the color stereoscopic TV 
screen. Figure 16 [not reproduced) shows the remote control in progress. 


When the operator remotely controls «11 of the manipulative work, his burden 
will be extremely heavy. Accordingly, as previously mentioned,this robot 
employs a method in which the manipulator is automatically or autonomously 
controlled and placed close to an object based on the distance inforsstion 
obtained from image information sent fros the visual sensor. 


As a result of conducting the above tests, it has been confirmed that the 
vee of this method will decrease the burden on the cperators. 
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Figure 14. Tester Configuration for Intelligent Working Robot 


5. Conclusion 


As mentioned previously, we have developed the AIMARS, and have grasped its 
basic performance. We are currently continuing tests and studies of a 
cableless robot, and are planning to improve the AIMARS functions further. 


Also, the AIMARS is somewhat limited by environmental conditions when use 
of the visual sensor is involved. On the other hand, however, with regard 
to "Robot Engaged in Very Dangerous Environments" being developed as a 
significant project by the AIST, we have developed a visual information 
processing technology which can be used to recognize object, such as valves 
and pumps, in very complex environments in nuclear power plants.':**"* The 
AIST is scheduled to complete this project by FY 1990. We are scheduled to 
fully utilize the above technology in the AIMARS, to expand the locomotion 
and working ranges of the robot, and to put the robot close to practical use 
in the future. 
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